Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6690 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6685 originally caused by: Started by upstream project "master-libgtpnl" build number 1813 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5193 originally caused by: Started by upstream project "master-osmo-pcu" build number 5361 originally caused by: Started by upstream project "master-libosmo-gprs" build number 136 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu" build number 5154 originally caused by: Started by upstream project "master-osmo-pcu" build number 5361 originally caused by: Started by upstream project "master-libosmo-gprs" build number 136 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3911 originally caused by: Started by upstream project "master-osmo-pcu" build number 5361 originally caused by: Started by upstream project "master-libosmo-gprs" build number 136 originally caused by: Started by timer Started by upstream project "master-osmo-pcu" build number 5362 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30087 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37255 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5194 originally caused by: Started by upstream project "master-osmo-pcu" build number 5362 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu" build number 5155 originally caused by: Started by upstream project "master-osmo-pcu" build number 5362 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30088 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37256 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6685 originally caused by: Started by upstream project "master-libgtpnl" build number 1813 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8959 originally caused by: Started by upstream project "master-osmo-mgw" build number 9191 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17680 originally caused by: Started by upstream project "master-osmo-bsc" build number 20141 originally caused by: Started by upstream project "master-osmo-mgw" build number 9191 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29304 originally caused by: Started by upstream project "master-osmo-msc" build number 34265 originally caused by: Started by upstream project "master-osmo-mgw" build number 9191 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17680 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7509 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6690 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8713 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8959 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2985 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29304 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5155 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30088 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4680 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12989 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9255 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4710 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8040 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5194 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5536 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3911 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins5699479115916113779.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-13 10:04:48 + trial_dir_prefix=trial- + rm -rf trial-2387 trial-2387-bin.tgz trial-2387-run.tgz + trial_dir=trial-2388 + mkdir -p trial-2388 + mv open5gs.build-8.tgz osmo-bsc.build-17680.tgz osmo-bts-oc2g.build-5536.tgz osmo-bts-sysmo.build-8040.tgz osmo-bts.build-7509.tgz osmo-ggsn.build-6690.tgz osmo-hlr.build-8713.tgz osmo-hnbgw.build-2985.tgz osmo-mgw.build-8959.tgz osmo-msc.build-29304.tgz osmo-nitb.build-12989.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30088.tgz osmo-stp.build-9255.tgz osmo-trx.build-4680.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz trial-2388 + cat open5gs.build-8.md5 osmo-bsc.build-17680.md5 osmo-bts-oc2g.build-5536.md5 osmo-bts-sysmo.build-8040.md5 osmo-bts.build-7509.md5 osmo-ggsn.build-6690.md5 osmo-hlr.build-8713.md5 osmo-hnbgw.build-2985.md5 osmo-mgw.build-8959.md5 osmo-msc.build-29304.md5 osmo-nitb.build-12989.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30088.md5 osmo-stp.build-9255.md5 osmo-trx.build-4680.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17680.md5 osmo-bts-oc2g.build-5536.md5 osmo-bts-sysmo.build-8040.md5 osmo-bts.build-7509.md5 osmo-ggsn.build-6690.md5 osmo-hlr.build-8713.md5 osmo-hnbgw.build-2985.md5 osmo-mgw.build-8959.md5 osmo-msc.build-29304.md5 osmo-nitb.build-12989.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30088.md5 osmo-stp.build-9255.md5 osmo-trx.build-4680.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2388 combinations: None trial: 'trial-2388' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2388 -------------------------------------------------------------------------------------------- 10:04:59.223227 tst trial-2388: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/log --------------------------------------------------------------------- trial-2388 nitb_sms:sysmo --------------------------------------------------------------------- 10:07:06.066650 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:07:06.071109 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 10:07:06.092768 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 10:07:06.100235 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 10:07:06.155222 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 10:07:06.176904 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 10:07:06.183876 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 10:07:06.721529 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 10:07:06.726649 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 10:07:06.737950 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 10:07:07.122069 tst mo_mt_sms.py: using LAC 33203 10:07:07.360373 tst mo_mt_sms.py: using RAC 53 10:07:07.475676 tst mo_mt_sms.py: using CellId 33203 10:07:07.591230 tst mo_mt_sms.py: using BVCI 33204 10:07:07.699343 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 10:07:07.881685 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 10:07:07.998411 tst mo_mt_sms.py:9: start nitb and bts... 10:07:08.201369 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:07:10.462214 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6941): Launched 10:07:10.768748 run osmo-nitb_10.42.42.2(pid=6942): Launched 10:07:10.935814 run osmo-nitb_10.42.42.2(pid=6942): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6942)] 10:07:11.060780 run osmo-nitb_10.42.42.2(pid=6942): stdout: | (launched: 2022-12-13_10:07:10.711598) 10:07:11.187377 run osmo-nitb_10.42.42.2(pid=6942): stderr: | (launched: 2022-12-13_10:07:10.756627) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:07:11.313869 run osmo-nitb_10.42.42.2(pid=6942): stdout: | (launched: 2022-12-13_10:07:10.711598) 10:07:11.434646 run osmo-nitb_10.42.42.2(pid=6942): stderr: | (launched: 2022-12-13_10:07:10.756627) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:07:11.579541 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6942): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6942) [trial-2388↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6942)] [trial-2388↪nitb_sms:sysmo↪mo_mt_sms.py:11] 10:07:11.587786 tst mo_mt_sms.py:11: Test FAILED (4.9 sec) 10:07:11.594308 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6941): Terminating (SIGTERM) 10:07:11.803640 --- ParallelTerminationStrategy: PID 6941 died... 10:07:11.824519 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6941): Terminated: ok {rc=0} 10:07:11.911736 bus /sierra_3: Setting Powered False 10:07:13.014068 bus /sierra_3: Setting Powered False 10:07:14.132822 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 sms:sysmo --------------------------------------------------------------------- 10:07:15.314157 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:07:15.319103 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 10:07:15.340538 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 10:07:15.367775 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 10:07:15.423969 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 10:07:15.444794 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 10:07:15.471289 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 10:07:16.018417 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 sms:sysmo mo_mt_sms.py ---------------------------------------------- 10:07:16.025379 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 10:07:16.037186 tst sms:sysmo: Using 1 x bts (candidates: 1) 10:07:16.076247 tst mo_mt_sms.py: using LAC 33204 10:07:16.246165 tst mo_mt_sms.py: using RAC 54 10:07:16.370395 tst mo_mt_sms.py: using CellId 33204 10:07:16.497874 tst mo_mt_sms.py: using BVCI 33205 10:07:16.623341 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 10:07:16.635292 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 10:07:16.646957 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 10:07:16.658632 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 10:07:16.671031 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 10:07:16.683252 tst sms:sysmo: Using 1 x modem (candidates: 2) 10:07:16.813570 tst sms:sysmo: Using 1 x modem (candidates: 2) 10:07:16.952607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:18.799768 run create_hlr_db(pid=6946): Launched 10:07:18.927159 bus /sierra_2: Setting Powered False 10:07:19.992372 run create_hlr_db(pid=6946): Terminated: ok {rc=0} 10:07:20.450700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6948): Launched 10:07:20.779489 run osmo-hlr_10.42.42.2(pid=6949): Launched 10:07:20.905318 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:23.492488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6951): Launched 10:07:23.822156 run osmo-stp_10.42.42.5(pid=6952): Launched 10:07:23.947570 run osmo-msc_10.42.42.6: Starting osmo-msc 10:07:29.391754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6954): Launched 10:07:29.718125 run osmo-msc_10.42.42.6(pid=6955): Launched 10:07:29.907673 run osmo-stp_10.42.42.5(pid=6952): ERR: Terminated: ERROR {rc=1} [trial-2388↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6952)] 10:07:30.045984 run osmo-stp_10.42.42.5(pid=6952): stdout: | (launched: 2022-12-13_10:07:23.760546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:30.184280 run osmo-stp_10.42.42.5(pid=6952): stderr: | 20221213100723951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100723951 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100723951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100723952 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100723952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100723953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100723953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:30.322008 run osmo-stp_10.42.42.5(pid=6952): stdout: | (launched: 2022-12-13_10:07:23.760546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:30.452168 run osmo-stp_10.42.42.5(pid=6952): stderr: | 20221213100723951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100723951 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100723951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100723952 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100723952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100723953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100723953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:30.607844 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6952): Process ended prematurely: osmo-stp_10.42.42.5(pid=6952) [trial-2388↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6952)] [trial-2388↪sms:sysmo↪mo_mt_sms.py:16] 10:07:30.616813 tst mo_mt_sms.py:16: Test FAILED (14.6 sec) 10:07:30.644354 run osmo-hlr_10.42.42.2(pid=6949): ERR: Terminated: ERROR {rc=237} [trial-2388↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6949)] 10:07:30.696318 run osmo-hlr_10.42.42.2(pid=6949): stdout: | (launched: 2022-12-13_10:07:20.718154) 10:07:30.749506 run osmo-hlr_10.42.42.2(pid=6949): stderr: | 20221213100720914 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100720914 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100720914 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100720914 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100720914 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100720914 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100720927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100720936 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100720936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100720936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:30.822790 run osmo-msc_10.42.42.6(pid=6955): ERR: Terminated: ERROR {rc=2} [trial-2388↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6955)] 10:07:30.873986 run osmo-msc_10.42.42.6(pid=6955): stdout: | (launched: 2022-12-13_10:07:29.657085) 10:07:30.934074 run osmo-msc_10.42.42.6(pid=6955): stderr: | 20221213100730028 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100730028 DLGLOBAL DEBUG validating counter group 0x7f018d3bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100730028 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100730028 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100730028 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100730028 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100730030 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100730030 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100730031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100730031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:07:30.988221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6948): Terminating (SIGTERM) 10:07:31.031525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6951): Terminating (SIGTERM) 10:07:31.076016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6954): Terminating (SIGTERM) 10:07:31.131188 --- ParallelTerminationStrategy: PID 6948 died... 10:07:31.157219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6948): Terminated: ok {rc=0} 10:07:31.218279 --- ParallelTerminationStrategy: PID 6951 died... 10:07:31.244781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6951): Terminated: ok {rc=0} 10:07:31.305990 --- ParallelTerminationStrategy: PID 6954 died... 10:07:31.331930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6954): Terminated: ok {rc=0} 10:07:31.438865 bus /sierra_3: Setting Powered False 10:07:32.536680 bus /sierra_3: Setting Powered False 10:07:33.653059 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_ussd:sysmo --------------------------------------------------------------------- 10:07:34.873044 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:07:34.877079 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 10:07:34.897997 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 10:07:34.905227 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 10:07:34.939285 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 10:07:34.959912 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 10:07:34.966600 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 10:07:35.490244 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2388 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 10:07:35.496047 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 10:07:35.508617 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 10:07:35.594730 tst assert_extension.py: using LAC 33205 10:07:35.718056 tst assert_extension.py: using RAC 55 10:07:35.845933 tst assert_extension.py: using CellId 33205 10:07:35.972714 tst assert_extension.py: using BVCI 33206 10:07:36.090988 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 10:07:36.206885 tst assert_extension.py:10: start nitb and bts... 10:07:36.410811 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:07:37.033399 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6961): Launched 10:07:37.338940 run osmo-nitb_10.42.42.2(pid=6962): Launched 10:07:37.508659 run osmo-nitb_10.42.42.2(pid=6962): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6962)] 10:07:37.644526 run osmo-nitb_10.42.42.2(pid=6962): stdout: | (launched: 2022-12-13_10:07:37.281372) 10:07:37.781868 run osmo-nitb_10.42.42.2(pid=6962): stderr: | (launched: 2022-12-13_10:07:37.326376) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:07:37.919054 run osmo-nitb_10.42.42.2(pid=6962): stdout: | (launched: 2022-12-13_10:07:37.281372) 10:07:38.051123 run osmo-nitb_10.42.42.2(pid=6962): stderr: | (launched: 2022-12-13_10:07:37.326376) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6962): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6962) [trial-2388↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6962)] 10:07:38.455197 tst osmo-nitb_10.42.42.2(pid=6962): stdout: | (launched: 2022-12-13_10:07:37.281372) 10:07:38.577870 tst osmo-nitb_10.42.42.2(pid=6962): stderr: | (launched: 2022-12-13_10:07:37.326376) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:07:38.722575 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6962): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6962) [trial-2388↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6962)] [trial-2388↪nitb_ussd:sysmo↪assert_extension.py:12] 10:07:38.730801 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:07:38.737525 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6961): Terminating (SIGTERM) 10:07:38.946320 --- ParallelTerminationStrategy: PID 6961 died... 10:07:38.967295 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6961): Terminated: ok {rc=0} 10:07:39.053553 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 ussd:sysmo --------------------------------------------------------------------- 10:07:40.232667 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:07:40.236367 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 10:07:40.256880 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 10:07:40.283380 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 10:07:40.318864 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 10:07:40.339286 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 10:07:40.365412 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 10:07:40.940309 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2388 ussd:sysmo assert_extension.py ---------------------------------------------- 10:07:40.948215 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 10:07:40.961059 tst ussd:sysmo: Using 1 x bts (candidates: 1) 10:07:41.052036 tst assert_extension.py: using LAC 33206 10:07:41.232743 tst assert_extension.py: using RAC 56 10:07:41.364819 tst assert_extension.py: using CellId 33206 10:07:41.483525 tst assert_extension.py: using BVCI 33207 10:07:41.593224 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 10:07:41.603771 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 10:07:41.614809 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 10:07:41.625343 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 10:07:41.635688 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 10:07:41.646216 tst ussd:sysmo: Using 1 x modem (candidates: 1) 10:07:41.766374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:42.276710 run create_hlr_db(pid=6967): Launched 10:07:42.402832 bus /sierra_2: Setting Powered False 10:07:43.466828 run create_hlr_db(pid=6967): Terminated: ok {rc=0} 10:07:43.906491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6969): Launched 10:07:44.215072 run osmo-hlr_10.42.42.2(pid=6970): Launched 10:07:44.332492 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:44.860440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6972): Launched 10:07:45.168663 run osmo-stp_10.42.42.5(pid=6973): Launched 10:07:45.286205 run osmo-msc_10.42.42.6: Starting osmo-msc 10:07:45.836172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6975): Launched 10:07:46.173869 run osmo-msc_10.42.42.6(pid=6976): Launched 10:07:46.451320 run osmo-stp_10.42.42.5(pid=6973): ERR: Terminated: ERROR {rc=1} [trial-2388↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6973)] 10:07:46.642702 run osmo-stp_10.42.42.5(pid=6973): stdout: | (launched: 2022-12-13_10:07:45.111075) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:46.876344 run osmo-stp_10.42.42.5(pid=6973): stderr: | 20221213100745280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100745280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100745280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100745280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100745281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100745281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100745281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:47.060923 run osmo-stp_10.42.42.5(pid=6973): stdout: | (launched: 2022-12-13_10:07:45.111075) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:47.232279 run osmo-stp_10.42.42.5(pid=6973): stderr: | 20221213100745280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100745280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100745280 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100745280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100745281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100745281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100745281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:47.397144 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6973): Process ended prematurely: osmo-stp_10.42.42.5(pid=6973) [trial-2388↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6973)] [trial-2388↪ussd:sysmo↪assert_extension.py:17] 10:07:47.407338 tst assert_extension.py:17: Test FAILED (6.5 sec) 10:07:47.436504 run osmo-hlr_10.42.42.2(pid=6970): ERR: Terminated: ERROR {rc=237} [trial-2388↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6970)] 10:07:47.491304 run osmo-hlr_10.42.42.2(pid=6970): stdout: | (launched: 2022-12-13_10:07:44.157711) 10:07:47.545061 run osmo-hlr_10.42.42.2(pid=6970): stderr: | 20221213100744336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100744336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100744336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100744336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100744336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100744336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100744347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100744355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100744356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100744356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:47.619531 run osmo-msc_10.42.42.6(pid=6976): ERR: Terminated: ERROR {rc=2} [trial-2388↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6976)] 10:07:47.671643 run osmo-msc_10.42.42.6(pid=6976): stdout: | (launched: 2022-12-13_10:07:46.111481) 10:07:47.725581 run osmo-msc_10.42.42.6(pid=6976): stderr: | 20221213100746680 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100746681 DLGLOBAL DEBUG validating counter group 0x7f5739001c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100746683 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100746684 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100746684 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100746685 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100746690 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100746690 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100746690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100746690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:07:47.779544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6969): Terminating (SIGTERM) 10:07:47.822540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6972): Terminating (SIGTERM) 10:07:47.865721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6975): Terminating (SIGTERM) 10:07:47.909231 --- ParallelTerminationStrategy: PID 6969 died... 10:07:47.929915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6969): Terminated: ok {rc=0} 10:07:47.977627 --- ParallelTerminationStrategy: PID 6972 died... 10:07:47.998087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6972): Terminated: ok {rc=0} 10:07:48.045705 --- ParallelTerminationStrategy: PID 6975 died... 10:07:48.066026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6975): Terminated: ok {rc=0} 10:07:48.156174 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:07:49.355463 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:07:49.362658 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:07:49.384101 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:07:49.413816 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:07:49.469826 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:07:49.491833 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:07:49.519683 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:07:50.064220 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:07:50.116759 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:07:50.127934 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:07:50.186886 tst mo_mt_call.py: using LAC 33207 10:07:50.308513 tst mo_mt_call.py: using RAC 57 10:07:50.427889 tst mo_mt_call.py: using CellId 33207 10:07:50.548888 tst mo_mt_call.py: using BVCI 33208 10:07:50.660488 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:07:50.671647 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:07:50.682485 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:07:50.693449 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:07:50.704216 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:07:50.715205 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:07:50.836785 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:07:50.955918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:51.440177 run create_hlr_db(pid=6981): Launched 10:07:51.568012 bus /sierra_2: Setting Powered False 10:07:52.629932 run create_hlr_db(pid=6981): Terminated: ok {rc=0} 10:07:53.087470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6983): Launched 10:07:53.405650 run osmo-hlr_10.42.42.2(pid=6984): Launched 10:07:53.536418 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:54.115453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6986): Launched 10:07:54.450862 run osmo-stp_10.42.42.5(pid=6987): Launched 10:07:54.580509 run osmo-msc_10.42.42.6: Starting osmo-msc 10:07:55.184084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6989): Launched 10:07:55.521398 run osmo-msc_10.42.42.6(pid=6990): Launched 10:07:55.710244 run osmo-stp_10.42.42.5(pid=6987): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6987)] 10:07:55.851822 run osmo-stp_10.42.42.5(pid=6987): stdout: | (launched: 2022-12-13_10:07:54.388649) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:55.994925 run osmo-stp_10.42.42.5(pid=6987): stderr: | 20221213100754582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100754582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100754582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100754582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100754583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100754583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100754583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:56.133749 run osmo-stp_10.42.42.5(pid=6987): stdout: | (launched: 2022-12-13_10:07:54.388649) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:56.266302 run osmo-stp_10.42.42.5(pid=6987): stderr: | 20221213100754582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100754582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100754582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100754582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100754583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100754583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100754583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:56.425375 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6987): Process ended prematurely: osmo-stp_10.42.42.5(pid=6987) [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6987)] [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:07:56.434885 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:07:56.462786 run osmo-hlr_10.42.42.2(pid=6984): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6984)] 10:07:56.514442 run osmo-hlr_10.42.42.2(pid=6984): stdout: | (launched: 2022-12-13_10:07:53.345547) 10:07:56.568309 run osmo-hlr_10.42.42.2(pid=6984): stderr: | 20221213100753542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100753542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100753542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100753542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100753542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100753542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100753558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100753567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100753568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100753568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:56.642343 run osmo-msc_10.42.42.6(pid=6990): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6990)] 10:07:56.693297 run osmo-msc_10.42.42.6(pid=6990): stdout: | (launched: 2022-12-13_10:07:55.458884) 10:07:56.746307 run osmo-msc_10.42.42.6(pid=6990): stderr: | 20221213100755779 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100755779 DLGLOBAL DEBUG validating counter group 0x7fc3e6afac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100755780 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100755780 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100755780 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100755780 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100755782 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100755782 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100755782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100755782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:07:56.799705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6983): Terminating (SIGTERM) 10:07:56.842125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6986): Terminating (SIGTERM) 10:07:56.884861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6989): Terminating (SIGTERM) 10:07:56.927985 --- ParallelTerminationStrategy: PID 6983 died... 10:07:56.948869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6983): Terminated: ok {rc=0} 10:07:56.996273 --- ParallelTerminationStrategy: PID 6986 died... 10:07:57.016437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6986): Terminated: ok {rc=0} 10:07:57.064044 --- ParallelTerminationStrategy: PID 6989 died... 10:07:57.084144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6989): Terminated: ok {rc=0} 10:07:57.174236 bus /sierra_3: Setting Powered False 10:07:58.274941 bus /sierra_3: Setting Powered False 10:07:59.392532 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:08:00.545768 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:08:00.558235 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:08:00.616474 tst mo_mt_call_osmux.py: using LAC 33208 10:08:00.747386 tst mo_mt_call_osmux.py: using RAC 58 10:08:00.883515 tst mo_mt_call_osmux.py: using CellId 33208 10:08:01.031429 tst mo_mt_call_osmux.py: using BVCI 33209 10:08:01.159175 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:08:01.171692 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:08:01.184191 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:08:01.196653 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:08:01.210341 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:08:01.223727 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:08:01.378770 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:08:01.534300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:02.152312 run create_hlr_db(pid=6992): Launched 10:08:02.314157 bus /sierra_2: Setting Powered False 10:08:03.379959 run create_hlr_db(pid=6992): Terminated: ok {rc=0} 10:08:03.827727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6994): Launched 10:08:04.141621 run osmo-hlr_10.42.42.2(pid=6995): Launched 10:08:04.259863 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:04.796521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6997): Launched 10:08:05.111427 run osmo-stp_10.42.42.5(pid=6998): Launched 10:08:05.232262 run osmo-msc_10.42.42.6: Starting osmo-msc 10:08:05.796800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7000): Launched 10:08:06.111376 run osmo-msc_10.42.42.6(pid=7001): Launched 10:08:06.286771 run osmo-stp_10.42.42.5(pid=6998): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6998)] 10:08:06.418566 run osmo-stp_10.42.42.5(pid=6998): stdout: | (launched: 2022-12-13_10:08:05.052485) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:06.550214 run osmo-stp_10.42.42.5(pid=6998): stderr: | 20221213100805224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100805224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100805225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100805225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100805226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100805226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100805226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:06.679604 run osmo-stp_10.42.42.5(pid=6998): stdout: | (launched: 2022-12-13_10:08:05.052485) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:06.803700 run osmo-stp_10.42.42.5(pid=6998): stderr: | 20221213100805224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100805224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100805225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100805225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100805226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100805226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100805226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:06.951929 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6998): Process ended prematurely: osmo-stp_10.42.42.5(pid=6998) [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6998)] [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:08:06.963816 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:08:06.990500 run osmo-hlr_10.42.42.2(pid=6995): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6995)] 10:08:07.040087 run osmo-hlr_10.42.42.2(pid=6995): stdout: | (launched: 2022-12-13_10:08:04.083089) 10:08:07.090749 run osmo-hlr_10.42.42.2(pid=6995): stderr: | 20221213100804258 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100804259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100804259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100804259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100804259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100804259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100804271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100804279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100804280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100804280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:07.161669 run osmo-msc_10.42.42.6(pid=7001): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7001)] 10:08:07.209952 run osmo-msc_10.42.42.6(pid=7001): stdout: | (launched: 2022-12-13_10:08:06.052533) 10:08:07.260134 run osmo-msc_10.42.42.6(pid=7001): stderr: | 20221213100806324 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100806324 DLGLOBAL DEBUG validating counter group 0x7fb1948fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100806324 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100806324 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100806324 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100806324 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100806326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100806327 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100806327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100806327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:08:07.310419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6994): Terminating (SIGTERM) 10:08:07.350371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6997): Terminating (SIGTERM) 10:08:07.390445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7000): Terminating (SIGTERM) 10:08:07.430757 --- ParallelTerminationStrategy: PID 6994 died... 10:08:07.450256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6994): Terminated: ok {rc=0} 10:08:07.495107 --- ParallelTerminationStrategy: PID 6997 died... 10:08:07.514325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6997): Terminated: ok {rc=0} 10:08:07.558928 --- ParallelTerminationStrategy: PID 7000 died... 10:08:07.577635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7000): Terminated: ok {rc=0} 10:08:07.662281 bus /sierra_3: Setting Powered False 10:08:08.763239 bus /sierra_3: Setting Powered False 10:08:09.883740 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:08:11.118259 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:11.124583 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:08:11.145365 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:08:11.171972 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:08:11.224575 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:08:11.246065 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:08:11.273678 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:08:11.824179 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:08:11.873527 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:08:11.884690 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:08:11.940586 tst mo_mt_call.py: using LAC 33209 10:08:12.064900 tst mo_mt_call.py: using RAC 59 10:08:12.193082 tst mo_mt_call.py: using CellId 33209 10:08:12.323558 tst mo_mt_call.py: using BVCI 33210 10:08:12.444810 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:08:12.456597 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:08:12.468188 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:08:12.479772 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:08:12.491786 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:08:12.504370 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:08:12.629208 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:08:12.751350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:13.271095 run create_hlr_db(pid=7006): Launched 10:08:13.398718 bus /sierra_2: Setting Powered False 10:08:14.463836 run create_hlr_db(pid=7006): Terminated: ok {rc=0} 10:08:14.909600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7008): Launched 10:08:15.222061 run osmo-hlr_10.42.42.2(pid=7009): Launched 10:08:15.342272 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:15.895142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7011): Launched 10:08:16.287542 run osmo-stp_10.42.42.5(pid=7012): Launched 10:08:16.530761 run osmo-msc_10.42.42.6: Starting osmo-msc 10:08:17.164211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7014): Launched 10:08:17.484711 run osmo-msc_10.42.42.6(pid=7015): Launched 10:08:17.659164 run osmo-stp_10.42.42.5(pid=7012): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7012)] 10:08:17.789872 run osmo-stp_10.42.42.5(pid=7012): stdout: | (launched: 2022-12-13_10:08:16.228080) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:17.921242 run osmo-stp_10.42.42.5(pid=7012): stderr: | 20221213100816558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100816558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100816559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100816559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100816559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100816560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100816560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:18.050170 run osmo-stp_10.42.42.5(pid=7012): stdout: | (launched: 2022-12-13_10:08:16.228080) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:18.174001 run osmo-stp_10.42.42.5(pid=7012): stderr: | 20221213100816558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100816558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100816559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100816559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100816559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100816560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100816560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:18.322198 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7012): Process ended prematurely: osmo-stp_10.42.42.5(pid=7012) [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7012)] [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:08:18.331102 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:08:18.357554 run osmo-hlr_10.42.42.2(pid=7009): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7009)] 10:08:18.405941 run osmo-hlr_10.42.42.2(pid=7009): stdout: | (launched: 2022-12-13_10:08:15.163584) 10:08:18.455642 run osmo-hlr_10.42.42.2(pid=7009): stderr: | 20221213100815340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100815341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100815341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100815341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100815341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100815341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100815353 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100815361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100815361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100815361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:18.524714 run osmo-msc_10.42.42.6(pid=7015): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7015)] 10:08:18.572861 run osmo-msc_10.42.42.6(pid=7015): stdout: | (launched: 2022-12-13_10:08:17.425945) 10:08:18.622551 run osmo-msc_10.42.42.6(pid=7015): stderr: | 20221213100817700 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100817700 DLGLOBAL DEBUG validating counter group 0x7fd46da5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100817701 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100817701 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100817701 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100817701 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100817703 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100817703 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100817703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100817703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:08:18.672567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7008): Terminating (SIGTERM) 10:08:18.712596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7011): Terminating (SIGTERM) 10:08:18.752638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7014): Terminating (SIGTERM) 10:08:18.792937 --- ParallelTerminationStrategy: PID 7008 died... 10:08:18.812328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7008): Terminated: ok {rc=0} 10:08:18.856796 --- ParallelTerminationStrategy: PID 7011 died... 10:08:18.875492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7011): Terminated: ok {rc=0} 10:08:18.920274 --- ParallelTerminationStrategy: PID 7014 died... 10:08:18.939276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7014): Terminated: ok {rc=0} 10:08:19.024193 bus /sierra_3: Setting Powered False 10:08:20.123252 bus /sierra_3: Setting Powered False 10:08:21.242102 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:08:22.395072 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:08:22.407456 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:08:22.466225 tst mo_mt_call_osmux.py: using LAC 33210 10:08:22.599271 tst mo_mt_call_osmux.py: using RAC 60 10:08:22.730255 tst mo_mt_call_osmux.py: using CellId 33210 10:08:22.863268 tst mo_mt_call_osmux.py: using BVCI 33211 10:08:22.987057 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:08:22.998710 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:08:23.010199 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:08:23.021552 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:08:23.033215 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:08:23.044867 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:08:23.167878 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:08:23.288778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:23.774083 run create_hlr_db(pid=7017): Launched 10:08:23.904267 bus /sierra_2: Setting Powered False 10:08:24.966181 run create_hlr_db(pid=7017): Terminated: ok {rc=0} 10:08:25.423018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7019): Launched 10:08:25.759727 run osmo-hlr_10.42.42.2(pid=7020): Launched 10:08:25.888849 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:26.470398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7022): Launched 10:08:26.806494 run osmo-stp_10.42.42.5(pid=7023): Launched 10:08:26.933893 run osmo-msc_10.42.42.6: Starting osmo-msc 10:08:27.538733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7025): Launched 10:08:27.874021 run osmo-msc_10.42.42.6(pid=7026): Launched 10:08:28.060859 run osmo-stp_10.42.42.5(pid=7023): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7023)] 10:08:28.201987 run osmo-stp_10.42.42.5(pid=7023): stdout: | (launched: 2022-12-13_10:08:26.743873) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:28.343550 run osmo-stp_10.42.42.5(pid=7023): stderr: | 20221213100826936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100826936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100826937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100826937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100826938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100826938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100826938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:28.482687 run osmo-stp_10.42.42.5(pid=7023): stdout: | (launched: 2022-12-13_10:08:26.743873) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:28.615776 run osmo-stp_10.42.42.5(pid=7023): stderr: | 20221213100826936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100826936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100826937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100826937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100826938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100826938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100826938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:28.775095 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7023): Process ended prematurely: osmo-stp_10.42.42.5(pid=7023) [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7023)] [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:08:28.784714 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:08:28.812831 run osmo-hlr_10.42.42.2(pid=7020): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7020)] 10:08:28.864165 run osmo-hlr_10.42.42.2(pid=7020): stdout: | (launched: 2022-12-13_10:08:25.697112) 10:08:28.916643 run osmo-hlr_10.42.42.2(pid=7020): stderr: | 20221213100825895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100825895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100825895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100825895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100825895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100825895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100825907 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100825917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100825917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100825917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:28.990653 run osmo-msc_10.42.42.6(pid=7026): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7026)] 10:08:29.041354 run osmo-msc_10.42.42.6(pid=7026): stdout: | (launched: 2022-12-13_10:08:27.811524) 10:08:29.094015 run osmo-msc_10.42.42.6(pid=7026): stderr: | 20221213100828134 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100828134 DLGLOBAL DEBUG validating counter group 0x7f8ff5b75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100828134 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100828134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100828134 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100828134 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100828136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100828136 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100828137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100828137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:08:29.147491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7019): Terminating (SIGTERM) 10:08:29.189949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7022): Terminating (SIGTERM) 10:08:29.233027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7025): Terminating (SIGTERM) 10:08:29.275936 --- ParallelTerminationStrategy: PID 7019 died... 10:08:29.296786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7019): Terminated: ok {rc=0} 10:08:29.343963 --- ParallelTerminationStrategy: PID 7022 died... 10:08:29.364197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7022): Terminated: ok {rc=0} 10:08:29.410964 --- ParallelTerminationStrategy: PID 7025 died... 10:08:29.431109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7025): Terminated: ok {rc=0} 10:08:29.521395 bus /sierra_3: Setting Powered False 10:08:30.621389 bus /sierra_3: Setting Powered False 10:08:31.739655 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:08:32.980481 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:32.988029 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:08:33.009498 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:08:33.037895 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:08:33.091726 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:08:33.113567 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:08:33.141056 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:08:33.690608 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:08:33.744477 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:08:33.756091 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:08:33.813655 tst mo_mt_call.py: using LAC 33211 10:08:33.944865 tst mo_mt_call.py: using RAC 61 10:08:34.076929 tst mo_mt_call.py: using CellId 33211 10:08:34.209714 tst mo_mt_call.py: using BVCI 33212 10:08:34.332720 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:08:34.344398 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:08:34.355757 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:08:34.367051 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:08:34.378753 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:08:34.390438 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:08:34.509776 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:08:34.633328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:35.153413 run create_hlr_db(pid=7031): Launched 10:08:35.280885 bus /sierra_2: Setting Powered False 10:08:36.346583 run create_hlr_db(pid=7031): Terminated: ok {rc=0} 10:08:36.811563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7033): Launched 10:08:37.149129 run osmo-hlr_10.42.42.2(pid=7034): Launched 10:08:37.278900 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:37.857645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7036): Launched 10:08:38.193938 run osmo-stp_10.42.42.5(pid=7037): Launched 10:08:38.321758 run osmo-msc_10.42.42.6: Starting osmo-msc 10:08:38.925670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7039): Launched 10:08:39.263036 run osmo-msc_10.42.42.6(pid=7040): Launched 10:08:39.449334 run osmo-stp_10.42.42.5(pid=7037): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7037)] 10:08:39.590152 run osmo-stp_10.42.42.5(pid=7037): stdout: | (launched: 2022-12-13_10:08:38.131241) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:39.731557 run osmo-stp_10.42.42.5(pid=7037): stderr: | 20221213100838321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100838321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100838322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100838322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100838323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100838323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100838323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:39.870844 run osmo-stp_10.42.42.5(pid=7037): stdout: | (launched: 2022-12-13_10:08:38.131241) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:40.004497 run osmo-stp_10.42.42.5(pid=7037): stderr: | 20221213100838321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100838321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100838322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100838322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100838323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100838323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100838323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:40.164075 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7037): Process ended prematurely: osmo-stp_10.42.42.5(pid=7037) [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7037)] [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:08:40.173707 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:08:40.201584 run osmo-hlr_10.42.42.2(pid=7034): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7034)] 10:08:40.252760 run osmo-hlr_10.42.42.2(pid=7034): stdout: | (launched: 2022-12-13_10:08:37.086593) 10:08:40.305424 run osmo-hlr_10.42.42.2(pid=7034): stderr: | 20221213100837281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100837282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100837282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100837282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100837282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100837282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100837294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100837304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100837304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100837304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:40.379413 run osmo-msc_10.42.42.6(pid=7040): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7040)] 10:08:40.430092 run osmo-msc_10.42.42.6(pid=7040): stdout: | (launched: 2022-12-13_10:08:39.200353) 10:08:40.483140 run osmo-msc_10.42.42.6(pid=7040): stderr: | 20221213100839524 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100839525 DLGLOBAL DEBUG validating counter group 0x7f184b734c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100839525 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100839525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100839525 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100839525 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100839527 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100839527 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100839527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100839527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:08:40.535943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7033): Terminating (SIGTERM) 10:08:40.578187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7036): Terminating (SIGTERM) 10:08:40.621216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7039): Terminating (SIGTERM) 10:08:40.663772 --- ParallelTerminationStrategy: PID 7033 died... 10:08:40.684365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7033): Terminated: ok {rc=0} 10:08:40.731168 --- ParallelTerminationStrategy: PID 7036 died... 10:08:40.751174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7036): Terminated: ok {rc=0} 10:08:40.798215 --- ParallelTerminationStrategy: PID 7039 died... 10:08:40.818297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7039): Terminated: ok {rc=0} 10:08:40.907814 bus /sierra_3: Setting Powered False 10:08:42.007933 bus /sierra_3: Setting Powered False 10:08:43.124426 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:08:44.277404 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:08:44.289579 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:08:44.347462 tst mo_mt_call_osmux.py: using LAC 33212 10:08:44.479231 tst mo_mt_call_osmux.py: using RAC 62 10:08:44.609062 tst mo_mt_call_osmux.py: using CellId 33212 10:08:44.741064 tst mo_mt_call_osmux.py: using BVCI 33213 10:08:44.863833 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:08:44.875365 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:08:44.886779 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:08:44.898207 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:08:44.909847 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:08:44.921474 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:08:45.040417 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:08:45.160326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:45.643469 run create_hlr_db(pid=7042): Launched 10:08:45.771805 bus /sierra_2: Setting Powered False 10:08:46.843280 run create_hlr_db(pid=7042): Terminated: ok {rc=0} 10:08:47.368595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7080): Launched 10:08:47.837135 run osmo-hlr_10.42.42.2(pid=7094): Launched 10:08:48.060712 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:48.979853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7192): Launched 10:08:49.415077 run osmo-stp_10.42.42.5(pid=7252): Launched 10:08:49.701978 run osmo-msc_10.42.42.6: Starting osmo-msc 10:08:50.451331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7320): Launched 10:08:50.786825 run osmo-msc_10.42.42.6(pid=7321): Launched 10:08:51.149252 run osmo-stp_10.42.42.5(pid=7252): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7252)] 10:08:51.439650 run osmo-stp_10.42.42.5(pid=7252): stdout: | (launched: 2022-12-13_10:08:49.340719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:51.643032 run osmo-stp_10.42.42.5(pid=7252): stderr: | 20221213100849671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100849672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100849672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100849672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100849674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100849674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100849674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:51.823212 run osmo-stp_10.42.42.5(pid=7252): stdout: | (launched: 2022-12-13_10:08:49.340719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:51.951039 run osmo-stp_10.42.42.5(pid=7252): stderr: | 20221213100849671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100849672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100849672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100849672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100849674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100849674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100849674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:52.103222 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7252): Process ended prematurely: osmo-stp_10.42.42.5(pid=7252) [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7252)] [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:08:52.113722 tst mo_mt_call_osmux.py:8: Test FAILED (7.9 sec) 10:08:52.141404 run osmo-hlr_10.42.42.2(pid=7094): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7094)] 10:08:52.191503 run osmo-hlr_10.42.42.2(pid=7094): stdout: | (launched: 2022-12-13_10:08:47.759699) 10:08:52.242673 run osmo-hlr_10.42.42.2(pid=7094): stderr: | 20221213100848184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100848184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100848184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100848184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100848184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100848184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100848213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100848229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100848229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100848229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:52.314627 run osmo-msc_10.42.42.6(pid=7321): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7321)] 10:08:52.363738 run osmo-msc_10.42.42.6(pid=7321): stdout: | (launched: 2022-12-13_10:08:50.726722) 10:08:52.415406 run osmo-msc_10.42.42.6(pid=7321): stderr: | 20221213100851347 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100851348 DLGLOBAL DEBUG validating counter group 0x7f7efbb19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100851348 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100851348 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100851348 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100851348 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100851362 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100851363 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100851363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100851363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:08:52.467503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7080): Terminating (SIGTERM) 10:08:52.510199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7192): Terminating (SIGTERM) 10:08:52.555418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7320): Terminating (SIGTERM) 10:08:52.600155 --- ParallelTerminationStrategy: PID 7080 died... 10:08:52.620635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7080): Terminated: ok {rc=0} 10:08:52.668407 --- ParallelTerminationStrategy: PID 7192 died... 10:08:52.688490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7192): Terminated: ok {rc=0} 10:08:52.734072 --- ParallelTerminationStrategy: PID 7320 died... 10:08:52.753949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7320): Terminated: ok {rc=0} 10:08:52.841767 bus /sierra_3: Setting Powered False 10:08:53.940289 bus /sierra_3: Setting Powered False 10:08:55.058151 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:08:56.304806 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:56.312896 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:08:56.336262 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:08:56.368862 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:08:56.423591 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:08:56.446317 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:08:56.476170 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:08:57.023729 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:08:57.078870 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:08:57.090942 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:08:57.151475 tst mo_mt_call.py: using LAC 33213 10:08:57.279587 tst mo_mt_call.py: using RAC 63 10:08:57.407315 tst mo_mt_call.py: using CellId 33213 10:08:57.536178 tst mo_mt_call.py: using BVCI 33214 10:08:57.654259 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:08:57.666991 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:08:57.678943 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:08:57.690910 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:08:57.704254 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:08:57.717576 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:08:57.842957 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:08:57.966379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:58.469981 run create_hlr_db(pid=7328): Launched 10:08:58.637799 bus /sierra_2: Setting Powered False 10:08:59.701276 run create_hlr_db(pid=7328): Terminated: ok {rc=0} 10:09:00.158025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7330): Launched 10:09:00.495637 run osmo-hlr_10.42.42.2(pid=7331): Launched 10:09:00.747117 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:01.535376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7333): Launched 10:09:02.017959 run osmo-stp_10.42.42.5(pid=7334): Launched 10:09:02.336629 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:02.995411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7336): Launched 10:09:03.347491 run osmo-msc_10.42.42.6(pid=7337): Launched 10:09:03.726769 run osmo-stp_10.42.42.5(pid=7334): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7334)] 10:09:04.006467 run osmo-stp_10.42.42.5(pid=7334): stdout: | (launched: 2022-12-13_10:09:01.948089) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:04.175428 run osmo-stp_10.42.42.5(pid=7334): stderr: | 20221213100902208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100902208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100902208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100902212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100902212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100902212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100902212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:04.318649 run osmo-stp_10.42.42.5(pid=7334): stdout: | (launched: 2022-12-13_10:09:01.948089) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:04.456019 run osmo-stp_10.42.42.5(pid=7334): stderr: | 20221213100902208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100902208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100902208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100902212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100902212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100902212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100902212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:04.620114 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7334): Process ended prematurely: osmo-stp_10.42.42.5(pid=7334) [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7334)] [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:09:04.630877 tst mo_mt_call.py:8: Test FAILED (7.6 sec) 10:09:04.660184 run osmo-hlr_10.42.42.2(pid=7331): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7331)] 10:09:04.715657 run osmo-hlr_10.42.42.2(pid=7331): stdout: | (launched: 2022-12-13_10:09:00.435153) 10:09:04.770816 run osmo-hlr_10.42.42.2(pid=7331): stderr: | 20221213100900782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100900782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100900782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100900782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100900782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100900782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100900801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100900813 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100900814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100900814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:04.847005 run osmo-msc_10.42.42.6(pid=7337): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7337)] 10:09:04.900104 run osmo-msc_10.42.42.6(pid=7337): stdout: | (launched: 2022-12-13_10:09:03.285169) 10:09:04.955098 run osmo-msc_10.42.42.6(pid=7337): stderr: | 20221213100903792 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100903792 DLGLOBAL DEBUG validating counter group 0x7f34a7a38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100903792 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100903792 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100903792 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100903792 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100903794 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100903794 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100903795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100903795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:05.011056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7330): Terminating (SIGTERM) 10:09:05.054664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7333): Terminating (SIGTERM) 10:09:05.099849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7336): Terminating (SIGTERM) 10:09:05.146464 --- ParallelTerminationStrategy: PID 7330 died... 10:09:05.168869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7330): Terminated: ok {rc=0} 10:09:05.219441 --- ParallelTerminationStrategy: PID 7333 died... 10:09:05.241368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7333): Terminated: ok {rc=0} 10:09:05.290317 --- ParallelTerminationStrategy: PID 7336 died... 10:09:05.312287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7336): Terminated: ok {rc=0} 10:09:05.406322 bus /sierra_3: Setting Powered False 10:09:06.510255 bus /sierra_3: Setting Powered False 10:09:07.634208 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:09:08.795805 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:09:08.809214 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:09:08.870381 tst mo_mt_call_osmux.py: using LAC 33214 10:09:09.009182 tst mo_mt_call_osmux.py: using RAC 64 10:09:09.149669 tst mo_mt_call_osmux.py: using CellId 33214 10:09:09.284149 tst mo_mt_call_osmux.py: using BVCI 33215 10:09:09.413333 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:09:09.426132 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:09:09.438610 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:09:09.451144 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:09:09.464837 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:09:09.478483 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:09:09.608689 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:09:09.740042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:10.282542 run create_hlr_db(pid=7339): Launched 10:09:10.454468 bus /sierra_2: Setting Powered False 10:09:11.519854 run create_hlr_db(pid=7339): Terminated: ok {rc=0} 10:09:11.994920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7341): Launched 10:09:12.331654 run osmo-hlr_10.42.42.2(pid=7342): Launched 10:09:12.461116 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:13.044362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7344): Launched 10:09:13.382038 run osmo-stp_10.42.42.5(pid=7345): Launched 10:09:13.509565 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:14.118797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7347): Launched 10:09:14.456798 run osmo-msc_10.42.42.6(pid=7348): Launched 10:09:14.644408 run osmo-stp_10.42.42.5(pid=7345): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7345)] 10:09:14.785244 run osmo-stp_10.42.42.5(pid=7345): stdout: | (launched: 2022-12-13_10:09:13.319278) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:14.926716 run osmo-stp_10.42.42.5(pid=7345): stderr: | 20221213100913511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100913511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100913511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100913512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100913512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100913512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100913512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:15.066708 run osmo-stp_10.42.42.5(pid=7345): stdout: | (launched: 2022-12-13_10:09:13.319278) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:15.199866 run osmo-stp_10.42.42.5(pid=7345): stderr: | 20221213100913511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100913511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100913511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100913512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100913512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100913512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100913512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:15.359582 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7345): Process ended prematurely: osmo-stp_10.42.42.5(pid=7345) [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7345)] [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:09:15.369317 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:09:15.397279 run osmo-hlr_10.42.42.2(pid=7342): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7342)] 10:09:15.448680 run osmo-hlr_10.42.42.2(pid=7342): stdout: | (launched: 2022-12-13_10:09:12.269338) 10:09:15.501900 run osmo-hlr_10.42.42.2(pid=7342): stderr: | 20221213100912470 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100912470 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100912470 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100912470 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100912470 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100912470 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100912483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100912493 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100912494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100912494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:15.575358 run osmo-msc_10.42.42.6(pid=7348): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7348)] 10:09:15.626006 run osmo-msc_10.42.42.6(pid=7348): stdout: | (launched: 2022-12-13_10:09:14.394473) 10:09:15.679122 run osmo-msc_10.42.42.6(pid=7348): stderr: | 20221213100914717 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100914718 DLGLOBAL DEBUG validating counter group 0x7f5b12cf2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100914718 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100914718 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100914718 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100914718 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100914720 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100914720 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100914721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100914721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:15.731574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7341): Terminating (SIGTERM) 10:09:15.774196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7344): Terminating (SIGTERM) 10:09:15.817232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7347): Terminating (SIGTERM) 10:09:15.861147 --- ParallelTerminationStrategy: PID 7341 died... 10:09:15.881758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7341): Terminated: ok {rc=0} 10:09:15.939458 --- ParallelTerminationStrategy: PID 7344 died... 10:09:15.960124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7344): Terminated: ok {rc=0} 10:09:16.008073 --- ParallelTerminationStrategy: PID 7347 died... 10:09:16.028897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7347): Terminated: ok {rc=0} 10:09:16.120185 bus /sierra_3: Setting Powered False 10:09:17.221213 bus /sierra_3: Setting Powered False 10:09:18.339759 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:09:19.574792 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:09:19.581626 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:09:19.602744 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:09:19.629838 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:09:19.681894 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:09:19.703504 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:09:19.731381 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:09:20.280789 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:09:20.335848 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:09:20.347363 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:09:20.405654 tst mo_mt_call.py: using LAC 33215 10:09:20.530620 tst mo_mt_call.py: using RAC 65 10:09:20.655245 tst mo_mt_call.py: using CellId 33215 10:09:20.780088 tst mo_mt_call.py: using BVCI 33216 10:09:20.894702 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:09:20.906015 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:09:20.917096 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:09:20.927859 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:09:20.938880 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:09:20.950054 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:09:21.072691 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:09:21.193053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:21.678860 run create_hlr_db(pid=7353): Launched 10:09:21.807734 bus /sierra_2: Setting Powered False 10:09:22.870501 run create_hlr_db(pid=7353): Terminated: ok {rc=0} 10:09:23.328731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7355): Launched 10:09:23.667231 run osmo-hlr_10.42.42.2(pid=7356): Launched 10:09:23.797453 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:24.378885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7358): Launched 10:09:24.717452 run osmo-stp_10.42.42.5(pid=7359): Launched 10:09:24.846280 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:25.449636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7361): Launched 10:09:25.785097 run osmo-msc_10.42.42.6(pid=7362): Launched 10:09:25.973096 run osmo-stp_10.42.42.5(pid=7359): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7359)] 10:09:26.114780 run osmo-stp_10.42.42.5(pid=7359): stdout: | (launched: 2022-12-13_10:09:24.655061) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:26.256659 run osmo-stp_10.42.42.5(pid=7359): stderr: | 20221213100924846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100924847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100924847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100924847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100924848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100924848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100924848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:26.395859 run osmo-stp_10.42.42.5(pid=7359): stdout: | (launched: 2022-12-13_10:09:24.655061) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:26.529195 run osmo-stp_10.42.42.5(pid=7359): stderr: | 20221213100924846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100924847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100924847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100924847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100924848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100924848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100924848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:26.688926 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7359): Process ended prematurely: osmo-stp_10.42.42.5(pid=7359) [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7359)] [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:09:26.698767 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:09:26.726800 run osmo-hlr_10.42.42.2(pid=7356): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7356)] 10:09:26.778212 run osmo-hlr_10.42.42.2(pid=7356): stdout: | (launched: 2022-12-13_10:09:23.604883) 10:09:26.830885 run osmo-hlr_10.42.42.2(pid=7356): stderr: | 20221213100923803 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100923803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100923803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100923803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100923803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100923803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100923814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100923822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100923822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100923822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:26.904100 run osmo-msc_10.42.42.6(pid=7362): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7362)] 10:09:26.954501 run osmo-msc_10.42.42.6(pid=7362): stdout: | (launched: 2022-12-13_10:09:25.722664) 10:09:27.007708 run osmo-msc_10.42.42.6(pid=7362): stderr: | 20221213100926046 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100926046 DLGLOBAL DEBUG validating counter group 0x7f630356ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100926046 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100926046 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100926046 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100926046 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100926048 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100926048 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100926049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100926049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:27.060779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7355): Terminating (SIGTERM) 10:09:27.103212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7358): Terminating (SIGTERM) 10:09:27.146455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7361): Terminating (SIGTERM) 10:09:27.189771 --- ParallelTerminationStrategy: PID 7355 died... 10:09:27.210600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7355): Terminated: ok {rc=0} 10:09:27.257837 --- ParallelTerminationStrategy: PID 7358 died... 10:09:27.278066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7358): Terminated: ok {rc=0} 10:09:27.325210 --- ParallelTerminationStrategy: PID 7361 died... 10:09:27.345574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7361): Terminated: ok {rc=0} 10:09:27.435234 bus /sierra_3: Setting Powered False 10:09:28.535018 bus /sierra_3: Setting Powered False 10:09:29.653321 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:09:30.803650 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:09:30.815566 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:09:30.876928 tst mo_mt_call_osmux.py: using LAC 33216 10:09:31.023134 tst mo_mt_call_osmux.py: using RAC 66 10:09:31.183281 tst mo_mt_call_osmux.py: using CellId 33216 10:09:31.313236 tst mo_mt_call_osmux.py: using BVCI 33217 10:09:31.474322 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:09:31.490394 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:09:31.506659 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:09:31.522913 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:09:31.538524 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:09:31.555106 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:09:31.711175 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:09:31.874150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:32.376928 run create_hlr_db(pid=7364): Launched 10:09:32.505923 bus /sierra_2: Setting Powered False 10:09:33.571718 run create_hlr_db(pid=7364): Terminated: ok {rc=0} 10:09:34.017927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7366): Launched 10:09:34.331258 run osmo-hlr_10.42.42.2(pid=7367): Launched 10:09:34.451417 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:34.998070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7369): Launched 10:09:35.313113 run osmo-stp_10.42.42.5(pid=7370): Launched 10:09:35.433575 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:35.995131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7372): Launched 10:09:36.310931 run osmo-msc_10.42.42.6(pid=7373): Launched 10:09:36.486342 run osmo-stp_10.42.42.5(pid=7370): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7370)] 10:09:36.617875 run osmo-stp_10.42.42.5(pid=7370): stdout: | (launched: 2022-12-13_10:09:35.254431) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:36.748175 run osmo-stp_10.42.42.5(pid=7370): stderr: | 20221213100935426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100935426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100935426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100935427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100935427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100935427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100935427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:36.877626 run osmo-stp_10.42.42.5(pid=7370): stdout: | (launched: 2022-12-13_10:09:35.254431) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:37.001408 run osmo-stp_10.42.42.5(pid=7370): stderr: | 20221213100935426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100935426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100935426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100935427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100935427 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100935427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100935427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:37.149410 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7370): Process ended prematurely: osmo-stp_10.42.42.5(pid=7370) [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7370)] [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:09:37.158255 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:09:37.184305 run osmo-hlr_10.42.42.2(pid=7367): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7367)] 10:09:37.232882 run osmo-hlr_10.42.42.2(pid=7367): stdout: | (launched: 2022-12-13_10:09:34.272781) 10:09:37.282773 run osmo-hlr_10.42.42.2(pid=7367): stderr: | 20221213100934448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100934448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100934448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100934448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100934448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100934448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100934461 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100934469 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100934469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100934469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:37.351899 run osmo-msc_10.42.42.6(pid=7373): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7373)] 10:09:37.399870 run osmo-msc_10.42.42.6(pid=7373): stdout: | (launched: 2022-12-13_10:09:36.251835) 10:09:37.449591 run osmo-msc_10.42.42.6(pid=7373): stderr: | 20221213100936523 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100936524 DLGLOBAL DEBUG validating counter group 0x7fa434b43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100936524 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100936524 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100936524 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100936524 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100936526 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100936526 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100936527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100936527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:37.499485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7366): Terminating (SIGTERM) 10:09:37.539580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7369): Terminating (SIGTERM) 10:09:37.579610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7372): Terminating (SIGTERM) 10:09:37.619621 --- ParallelTerminationStrategy: PID 7366 died... 10:09:37.638962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7366): Terminated: ok {rc=0} 10:09:37.683285 --- ParallelTerminationStrategy: PID 7369 died... 10:09:37.702214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7369): Terminated: ok {rc=0} 10:09:37.746655 --- ParallelTerminationStrategy: PID 7372 died... 10:09:37.765327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7372): Terminated: ok {rc=0} 10:09:37.851923 bus /sierra_3: Setting Powered False 10:09:38.952473 bus /sierra_3: Setting Powered False 10:09:40.067109 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:09:41.299768 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:09:41.306263 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:09:41.326807 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:09:41.353401 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:09:41.403963 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:09:41.425182 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:09:41.451932 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:09:42.001867 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:09:42.053034 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:09:42.064281 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:09:42.122107 tst mo_mt_call.py: using LAC 33217 10:09:42.254315 tst mo_mt_call.py: using RAC 67 10:09:42.384216 tst mo_mt_call.py: using CellId 33217 10:09:42.513603 tst mo_mt_call.py: using BVCI 33218 10:09:42.637081 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:09:42.648894 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:09:42.660501 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:09:42.672135 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:09:42.684033 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:09:42.695720 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:09:42.815234 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:09:42.937972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:43.459096 run create_hlr_db(pid=7378): Launched 10:09:43.587019 bus /sierra_2: Setting Powered False 10:09:44.652878 run create_hlr_db(pid=7378): Terminated: ok {rc=0} 10:09:45.099725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7380): Launched 10:09:45.413680 run osmo-hlr_10.42.42.2(pid=7381): Launched 10:09:45.532203 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:46.093648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7383): Launched 10:09:46.460035 run osmo-stp_10.42.42.5(pid=7384): Launched 10:09:46.708448 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:47.356766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7386): Launched 10:09:47.711051 run osmo-msc_10.42.42.6(pid=7387): Launched 10:09:47.897197 run osmo-stp_10.42.42.5(pid=7384): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7384)] 10:09:48.039414 run osmo-stp_10.42.42.5(pid=7384): stdout: | (launched: 2022-12-13_10:09:46.400056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:48.181659 run osmo-stp_10.42.42.5(pid=7384): stderr: | 20221213100946695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100946695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100946696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100946696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100946697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100946697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100946697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:48.321692 run osmo-stp_10.42.42.5(pid=7384): stdout: | (launched: 2022-12-13_10:09:46.400056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:48.455919 run osmo-stp_10.42.42.5(pid=7384): stderr: | 20221213100946695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100946695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100946696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100946696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100946697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100946697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100946697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:48.616026 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7384): Process ended prematurely: osmo-stp_10.42.42.5(pid=7384) [trial-2388↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7384)] [trial-2388↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:09:48.625966 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:09:48.653944 run osmo-hlr_10.42.42.2(pid=7381): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7381)] 10:09:48.705377 run osmo-hlr_10.42.42.2(pid=7381): stdout: | (launched: 2022-12-13_10:09:45.354997) 10:09:48.758611 run osmo-hlr_10.42.42.2(pid=7381): stderr: | 20221213100945532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100945532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100945532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100945532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100945532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100945532 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100945544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100945553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100945553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100945553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:48.831921 run osmo-msc_10.42.42.6(pid=7387): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7387)] 10:09:48.882609 run osmo-msc_10.42.42.6(pid=7387): stdout: | (launched: 2022-12-13_10:09:47.648265) 10:09:48.935444 run osmo-msc_10.42.42.6(pid=7387): stderr: | 20221213100947971 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100947971 DLGLOBAL DEBUG validating counter group 0x7fd8d04bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100947971 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100947971 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100947971 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100947971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100947973 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100947974 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100947974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100947974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:48.988854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7380): Terminating (SIGTERM) 10:09:49.031825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7383): Terminating (SIGTERM) 10:09:49.074466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7386): Terminating (SIGTERM) 10:09:49.117393 --- ParallelTerminationStrategy: PID 7380 died... 10:09:49.138114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7380): Terminated: ok {rc=0} 10:09:49.185427 --- ParallelTerminationStrategy: PID 7383 died... 10:09:49.205757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7383): Terminated: ok {rc=0} 10:09:49.253147 --- ParallelTerminationStrategy: PID 7386 died... 10:09:49.273452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7386): Terminated: ok {rc=0} 10:09:49.363790 bus /sierra_3: Setting Powered False 10:09:50.464790 bus /sierra_3: Setting Powered False 10:09:51.581825 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:09:52.734155 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:09:52.747084 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:09:52.806401 tst mo_mt_call_osmux.py: using LAC 33218 10:09:52.934533 tst mo_mt_call_osmux.py: using RAC 68 10:09:53.057028 tst mo_mt_call_osmux.py: using CellId 33218 10:09:53.177429 tst mo_mt_call_osmux.py: using BVCI 33219 10:09:53.292261 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:09:53.303585 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:09:53.314660 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:09:53.325647 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:09:53.336534 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:09:53.348100 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:09:53.470866 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:09:53.588891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:54.073625 run create_hlr_db(pid=7389): Launched 10:09:54.199732 bus /sierra_2: Setting Powered False 10:09:55.262003 run create_hlr_db(pid=7389): Terminated: ok {rc=0} 10:09:55.720779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7391): Launched 10:09:56.059329 run osmo-hlr_10.42.42.2(pid=7392): Launched 10:09:56.188274 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:56.766213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7394): Launched 10:09:57.103831 run osmo-stp_10.42.42.5(pid=7395): Launched 10:09:57.232588 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:57.837447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7397): Launched 10:09:58.175189 run osmo-msc_10.42.42.6(pid=7398): Launched 10:09:58.361683 run osmo-stp_10.42.42.5(pid=7395): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7395)] 10:09:58.502468 run osmo-stp_10.42.42.5(pid=7395): stdout: | (launched: 2022-12-13_10:09:57.041396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:58.644075 run osmo-stp_10.42.42.5(pid=7395): stderr: | 20221213100957236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100957236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100957236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100957237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100957237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100957237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100957238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:58.783885 run osmo-stp_10.42.42.5(pid=7395): stdout: | (launched: 2022-12-13_10:09:57.041396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:58.917276 run osmo-stp_10.42.42.5(pid=7395): stderr: | 20221213100957236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213100957236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213100957236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213100957237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213100957237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213100957237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213100957238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:59.077766 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7395): Process ended prematurely: osmo-stp_10.42.42.5(pid=7395) [trial-2388↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7395)] [trial-2388↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:09:59.087688 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:09:59.115764 run osmo-hlr_10.42.42.2(pid=7392): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7392)] 10:09:59.167118 run osmo-hlr_10.42.42.2(pid=7392): stdout: | (launched: 2022-12-13_10:09:55.996237) 10:09:59.219892 run osmo-hlr_10.42.42.2(pid=7392): stderr: | 20221213100956195 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213100956195 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213100956195 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213100956195 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213100956195 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213100956196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213100956208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213100956218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213100956219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213100956219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:59.292865 run osmo-msc_10.42.42.6(pid=7398): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7398)] 10:09:59.343479 run osmo-msc_10.42.42.6(pid=7398): stdout: | (launched: 2022-12-13_10:09:58.112619) 10:09:59.395800 run osmo-msc_10.42.42.6(pid=7398): stderr: | 20221213100958435 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213100958435 DLGLOBAL DEBUG validating counter group 0x7fa1927f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213100958435 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213100958435 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213100958435 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213100958436 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213100958437 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213100958438 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213100958438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213100958438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:59.448534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7391): Terminating (SIGTERM) 10:09:59.490969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7394): Terminating (SIGTERM) 10:09:59.534134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7397): Terminating (SIGTERM) 10:09:59.577099 --- ParallelTerminationStrategy: PID 7391 died... 10:09:59.597729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7391): Terminated: ok {rc=0} 10:09:59.644586 --- ParallelTerminationStrategy: PID 7394 died... 10:09:59.664921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7394): Terminated: ok {rc=0} 10:09:59.711879 --- ParallelTerminationStrategy: PID 7397 died... 10:09:59.732088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7397): Terminated: ok {rc=0} 10:09:59.820616 bus /sierra_3: Setting Powered False 10:10:00.934199 bus /sierra_3: Setting Powered False 10:10:02.056063 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:10:03.297689 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:10:03.304067 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:10:03.325552 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:10:03.355291 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:10:03.407978 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:10:03.429615 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:10:03.455861 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:10:04.004837 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:10:04.059746 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:10:04.071344 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:10:04.133397 tst mo_mt_call.py: using LAC 33219 10:10:04.263444 tst mo_mt_call.py: using RAC 69 10:10:04.392033 tst mo_mt_call.py: using CellId 33219 10:10:04.520871 tst mo_mt_call.py: using BVCI 33220 10:10:04.642129 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:10:04.653495 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:10:04.664539 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:10:04.675644 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:10:04.687123 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:10:04.698716 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:10:04.822378 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:10:04.943469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:05.428052 run create_hlr_db(pid=7406): Launched 10:10:05.557210 bus /sierra_2: Setting Powered False 10:10:06.619003 run create_hlr_db(pid=7406): Terminated: ok {rc=0} 10:10:07.076250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7408): Launched 10:10:07.411596 run osmo-hlr_10.42.42.2(pid=7409): Launched 10:10:07.540271 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:08.120240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7411): Launched 10:10:08.457841 run osmo-stp_10.42.42.5(pid=7412): Launched 10:10:08.587051 run osmo-msc_10.42.42.6: Starting osmo-msc 10:10:09.191652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7414): Launched 10:10:09.529333 run osmo-msc_10.42.42.6(pid=7415): Launched 10:10:09.715155 run osmo-stp_10.42.42.5(pid=7412): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7412)] 10:10:09.856149 run osmo-stp_10.42.42.5(pid=7412): stdout: | (launched: 2022-12-13_10:10:08.394922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:09.997481 run osmo-stp_10.42.42.5(pid=7412): stderr: | 20221213101008586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101008587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101008587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101008587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101008588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101008588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101008588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:10.136506 run osmo-stp_10.42.42.5(pid=7412): stdout: | (launched: 2022-12-13_10:10:08.394922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:10.269983 run osmo-stp_10.42.42.5(pid=7412): stderr: | 20221213101008586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101008587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101008587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101008587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101008588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101008588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101008588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:10.429382 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7412): Process ended prematurely: osmo-stp_10.42.42.5(pid=7412) [trial-2388↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7412)] [trial-2388↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:10:10.439152 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:10:10.467090 run osmo-hlr_10.42.42.2(pid=7409): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7409)] 10:10:10.518372 run osmo-hlr_10.42.42.2(pid=7409): stdout: | (launched: 2022-12-13_10:10:07.349490) 10:10:10.572031 run osmo-hlr_10.42.42.2(pid=7409): stderr: | 20221213101007549 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101007549 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101007549 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101007549 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101007549 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101007549 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101007561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101007571 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101007571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101007571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:10.645215 run osmo-msc_10.42.42.6(pid=7415): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7415)] 10:10:10.695686 run osmo-msc_10.42.42.6(pid=7415): stdout: | (launched: 2022-12-13_10:10:09.466910) 10:10:10.748577 run osmo-msc_10.42.42.6(pid=7415): stderr: | 20221213101009790 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101009790 DLGLOBAL DEBUG validating counter group 0x7fc591be6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101009790 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101009790 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101009790 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101009791 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101009792 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101009793 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101009793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101009793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:10:10.801723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7408): Terminating (SIGTERM) 10:10:10.844071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7411): Terminating (SIGTERM) 10:10:10.887047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7414): Terminating (SIGTERM) 10:10:10.929894 --- ParallelTerminationStrategy: PID 7408 died... 10:10:10.950538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7408): Terminated: ok {rc=0} 10:10:10.997781 --- ParallelTerminationStrategy: PID 7411 died... 10:10:11.017864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7411): Terminated: ok {rc=0} 10:10:11.064735 --- ParallelTerminationStrategy: PID 7414 died... 10:10:11.084810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7414): Terminated: ok {rc=0} 10:10:11.173141 bus /sierra_3: Setting Powered False 10:10:12.273106 bus /sierra_3: Setting Powered False 10:10:13.389433 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:10:14.539344 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:10:14.551223 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:10:14.609170 tst mo_mt_call_osmux.py: using LAC 33220 10:10:14.733084 tst mo_mt_call_osmux.py: using RAC 70 10:10:14.855048 tst mo_mt_call_osmux.py: using CellId 33220 10:10:14.978302 tst mo_mt_call_osmux.py: using BVCI 33221 10:10:15.093116 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:10:15.104072 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:10:15.114897 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:10:15.125591 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:10:15.136251 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:10:15.147386 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:10:15.271045 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:10:15.389309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:15.898365 run create_hlr_db(pid=7417): Launched 10:10:16.057081 bus /sierra_2: Setting Powered False 10:10:17.147517 run create_hlr_db(pid=7417): Terminated: ok {rc=0} 10:10:17.605965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7419): Launched 10:10:17.919566 run osmo-hlr_10.42.42.2(pid=7420): Launched 10:10:18.039360 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:18.591998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7422): Launched 10:10:18.907530 run osmo-stp_10.42.42.5(pid=7423): Launched 10:10:19.027119 run osmo-msc_10.42.42.6: Starting osmo-msc 10:10:19.589331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7425): Launched 10:10:19.903833 run osmo-msc_10.42.42.6(pid=7426): Launched 10:10:20.079761 run osmo-stp_10.42.42.5(pid=7423): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7423)] 10:10:20.215241 run osmo-stp_10.42.42.5(pid=7423): stdout: | (launched: 2022-12-13_10:10:18.848489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:20.346717 run osmo-stp_10.42.42.5(pid=7423): stderr: | 20221213101019018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101019019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101019019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101019019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101019020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101019020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101019020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:20.475914 run osmo-stp_10.42.42.5(pid=7423): stdout: | (launched: 2022-12-13_10:10:18.848489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:20.600720 run osmo-stp_10.42.42.5(pid=7423): stderr: | 20221213101019018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101019019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101019019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101019019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101019020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101019020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101019020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:20.748681 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7423): Process ended prematurely: osmo-stp_10.42.42.5(pid=7423) [trial-2388↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7423)] [trial-2388↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:10:20.757841 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:10:20.783900 run osmo-hlr_10.42.42.2(pid=7420): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7420)] 10:10:20.832358 run osmo-hlr_10.42.42.2(pid=7420): stdout: | (launched: 2022-12-13_10:10:17.861118) 10:10:20.881781 run osmo-hlr_10.42.42.2(pid=7420): stderr: | 20221213101018036 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101018036 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101018036 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101018036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101018036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101018036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101018048 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101018056 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101018057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101018057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:20.950985 run osmo-msc_10.42.42.6(pid=7426): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7426)] 10:10:20.998866 run osmo-msc_10.42.42.6(pid=7426): stdout: | (launched: 2022-12-13_10:10:19.844827) 10:10:21.048338 run osmo-msc_10.42.42.6(pid=7426): stderr: | 20221213101020120 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101020120 DLGLOBAL DEBUG validating counter group 0x7fdfd32afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101020120 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101020120 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101020120 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101020120 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101020122 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101020122 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101020123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101020123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:10:21.098216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7419): Terminating (SIGTERM) 10:10:21.137861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7422): Terminating (SIGTERM) 10:10:21.177652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7425): Terminating (SIGTERM) 10:10:21.217815 --- ParallelTerminationStrategy: PID 7419 died... 10:10:21.237220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7419): Terminated: ok {rc=0} 10:10:21.281255 --- ParallelTerminationStrategy: PID 7422 died... 10:10:21.299734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7422): Terminated: ok {rc=0} 10:10:21.343423 --- ParallelTerminationStrategy: PID 7425 died... 10:10:21.362441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7425): Terminated: ok {rc=0} 10:10:21.448120 bus /sierra_3: Setting Powered False 10:10:22.548243 bus /sierra_3: Setting Powered False 10:10:23.665670 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 emergency:sysmo --------------------------------------------------------------------- 10:10:24.900017 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:10:24.904653 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 10:10:24.925816 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 10:10:24.955176 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 10:10:25.044281 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 10:10:25.065950 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 10:10:25.092182 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 10:10:25.674860 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2388 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 10:10:25.680335 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 10:10:25.691659 tst emergency:sysmo: Using 1 x bts (candidates: 1) 10:10:25.728244 tst emergency_mo_mt_call.py: using LAC 33221 10:10:25.858256 tst emergency_mo_mt_call.py: using RAC 71 10:10:25.988560 tst emergency_mo_mt_call.py: using CellId 33221 10:10:26.118640 tst emergency_mo_mt_call.py: using BVCI 33222 10:10:26.239407 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 10:10:26.250601 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 10:10:26.261597 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 10:10:26.272427 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 10:10:26.283669 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 10:10:26.294969 tst emergency:sysmo: Using 1 x modem (candidates: 4) 10:10:26.414345 tst emergency:sysmo: Using 1 x modem (candidates: 4) 10:10:26.535291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:27.048559 run create_hlr_db(pid=7431): Launched 10:10:27.175390 bus /sierra_2: Setting Powered False 10:10:28.240177 run create_hlr_db(pid=7431): Terminated: ok {rc=0} 10:10:28.681989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7433): Launched 10:10:28.991898 run osmo-hlr_10.42.42.2(pid=7434): Launched 10:10:29.110318 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:29.639243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7436): Launched 10:10:29.949374 run osmo-stp_10.42.42.5(pid=7437): Launched 10:10:30.077469 tst emergency_mo_mt_call.py: using MSISDN 8105 10:10:30.247248 run osmo-msc_10.42.42.6: Starting osmo-msc 10:10:30.800290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7439): Launched 10:10:31.141692 run osmo-msc_10.42.42.6(pid=7440): Launched 10:10:31.489353 run osmo-stp_10.42.42.5(pid=7437): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7437)] 10:10:31.735182 run osmo-stp_10.42.42.5(pid=7437): stdout: | (launched: 2022-12-13_10:10:29.891329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:31.944800 run osmo-stp_10.42.42.5(pid=7437): stderr: | 20221213101030061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101030061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101030062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101030062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101030063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101030063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101030063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:32.101702 run osmo-stp_10.42.42.5(pid=7437): stdout: | (launched: 2022-12-13_10:10:29.891329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:32.227358 run osmo-stp_10.42.42.5(pid=7437): stderr: | 20221213101030061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101030061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101030062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101030062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101030063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101030063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101030063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:32.374963 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7437): Process ended prematurely: osmo-stp_10.42.42.5(pid=7437) [trial-2388↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7437)] [trial-2388↪emergency:sysmo↪emergency_mo_mt_call.py:19] 10:10:32.383429 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 10:10:32.409691 run osmo-hlr_10.42.42.2(pid=7434): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7434)] 10:10:32.458717 run osmo-hlr_10.42.42.2(pid=7434): stdout: | (launched: 2022-12-13_10:10:28.933871) 10:10:32.509041 run osmo-hlr_10.42.42.2(pid=7434): stderr: | 20221213101029110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101029110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101029110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101029110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101029110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101029110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101029123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101029131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101029131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101029131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:32.579111 run osmo-msc_10.42.42.6(pid=7440): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7440)] 10:10:32.627751 run osmo-msc_10.42.42.6(pid=7440): stdout: | (launched: 2022-12-13_10:10:31.072651) 10:10:32.678700 run osmo-msc_10.42.42.6(pid=7440): stderr: | 20221213101031652 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101031652 DLGLOBAL DEBUG validating counter group 0x7f7d9eab2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101031652 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101031652 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101031661 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101031661 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101031663 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101031663 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101031664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101031664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:10:32.729450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7433): Terminating (SIGTERM) 10:10:32.770094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7436): Terminating (SIGTERM) 10:10:32.810699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7439): Terminating (SIGTERM) 10:10:32.851293 --- ParallelTerminationStrategy: PID 7433 died... 10:10:32.870926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7433): Terminated: ok {rc=0} 10:10:32.915948 --- ParallelTerminationStrategy: PID 7436 died... 10:10:32.935118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7436): Terminated: ok {rc=0} 10:10:32.979817 --- ParallelTerminationStrategy: PID 7439 died... 10:10:32.998859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7439): Terminated: ok {rc=0} 10:10:33.086763 bus /sierra_3: Setting Powered False 10:10:34.186927 bus /sierra_3: Setting Powered False 10:10:35.301029 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 10:10:36.388495 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 10:10:36.400491 tst emergency:sysmo: Using 1 x bts (candidates: 1) 10:10:36.438559 tst emergency_preemptive_call.py: using LAC 33222 10:10:36.570089 tst emergency_preemptive_call.py: using RAC 72 10:10:36.698784 tst emergency_preemptive_call.py: using CellId 33222 10:10:36.828907 tst emergency_preemptive_call.py: using BVCI 33223 10:10:36.947884 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 10:10:36.959168 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 10:10:36.970692 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 10:10:36.983217 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 10:10:36.995742 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 10:10:37.007484 tst emergency:sysmo: Using 1 x modem (candidates: 4) 10:10:37.125703 tst emergency:sysmo: Using 1 x modem (candidates: 4) 10:10:37.247641 tst emergency:sysmo: Using 1 x modem (candidates: 4) 10:10:37.367797 tst emergency:sysmo: Using 1 x modem (candidates: 4) 10:10:37.487872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:37.999702 run create_hlr_db(pid=7442): Launched 10:10:38.126954 bus /sierra_2: Setting Powered False 10:10:39.191396 run create_hlr_db(pid=7442): Terminated: ok {rc=0} 10:10:39.651137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7444): Launched 10:10:39.983044 run osmo-hlr_10.42.42.2(pid=7445): Launched 10:10:40.109678 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:40.680665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7447): Launched 10:10:41.011703 run osmo-stp_10.42.42.5(pid=7448): Launched 10:10:41.147263 tst emergency_preemptive_call.py: using MSISDN 8106 10:10:41.319544 run osmo-msc_10.42.42.6: Starting osmo-msc 10:10:41.912543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7450): Launched 10:10:42.243902 run osmo-msc_10.42.42.6(pid=7451): Launched 10:10:42.436007 run osmo-stp_10.42.42.5(pid=7448): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7448)] 10:10:42.575070 run osmo-stp_10.42.42.5(pid=7448): stdout: | (launched: 2022-12-13_10:10:40.949873) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:42.714852 run osmo-stp_10.42.42.5(pid=7448): stderr: | 20221213101041140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101041140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101041140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101041141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101041141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101041141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101041142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:42.853524 run osmo-stp_10.42.42.5(pid=7448): stdout: | (launched: 2022-12-13_10:10:40.949873) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:42.985444 run osmo-stp_10.42.42.5(pid=7448): stderr: | 20221213101041140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101041140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101041140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101041141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101041141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101041141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101041142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:43.143566 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7448): Process ended prematurely: osmo-stp_10.42.42.5(pid=7448) [trial-2388↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7448)] [trial-2388↪emergency:sysmo↪emergency_preemptive_call.py:32] 10:10:43.152519 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 10:10:43.180177 run osmo-hlr_10.42.42.2(pid=7445): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7445)] 10:10:43.231922 run osmo-hlr_10.42.42.2(pid=7445): stdout: | (launched: 2022-12-13_10:10:39.920304) 10:10:43.285357 run osmo-hlr_10.42.42.2(pid=7445): stderr: | 20221213101040119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101040119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101040119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101040119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101040119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101040119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101040131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101040140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101040140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101040140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:43.358766 run osmo-msc_10.42.42.6(pid=7451): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7451)] 10:10:43.409328 run osmo-msc_10.42.42.6(pid=7451): stdout: | (launched: 2022-12-13_10:10:42.182022) 10:10:43.461828 run osmo-msc_10.42.42.6(pid=7451): stderr: | 20221213101042502 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101042502 DLGLOBAL DEBUG validating counter group 0x7f5d9f6fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101042502 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101042502 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101042502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101042502 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101042504 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101042505 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101042505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101042505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:10:43.515408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7444): Terminating (SIGTERM) 10:10:43.557791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7447): Terminating (SIGTERM) 10:10:43.600866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7450): Terminating (SIGTERM) 10:10:43.643976 --- ParallelTerminationStrategy: PID 7444 died... 10:10:43.664867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7444): Terminated: ok {rc=0} 10:10:43.712054 --- ParallelTerminationStrategy: PID 7447 died... 10:10:43.732349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7447): Terminated: ok {rc=0} 10:10:43.779357 --- ParallelTerminationStrategy: PID 7450 died... 10:10:43.799740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7450): Terminated: ok {rc=0} 10:10:43.889869 bus /sierra_9: Setting Powered False 10:10:44.986651 bus /sierra_9: Setting Powered False 10:10:46.103169 bus /sierra_8: Setting Powered False 10:10:47.217350 bus /sierra_8: Setting Powered False 10:10:48.337207 bus /sierra_3: Setting Powered False 10:10:49.437002 bus /sierra_3: Setting Powered False 10:10:50.555670 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:sysmo --------------------------------------------------------------------- 10:10:51.822863 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:10:51.827923 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 10:10:51.849509 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 10:10:51.890039 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 10:10:51.980003 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 10:10:52.001355 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 10:10:52.041878 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 10:10:52.630537 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 10:10:52.686496 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:10:52.697490 tst gprs:sysmo: Using 1 x bts (candidates: 1) 10:10:52.732659 tst cs_paging_gprs_active.py: using LAC 33223 10:10:52.865350 tst cs_paging_gprs_active.py: using RAC 73 10:10:52.997639 tst cs_paging_gprs_active.py: using CellId 33223 10:10:53.121648 tst cs_paging_gprs_active.py: using BVCI 33224 10:10:53.245905 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:10:53.256886 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:10:53.267871 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:10:53.278741 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:10:53.289868 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:10:53.300883 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:10:53.312175 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:10:53.323420 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:10:53.334782 tst gprs:sysmo: Using 1 x modem (candidates: 4) 10:10:53.454433 tst gprs:sysmo: Using 1 x modem (candidates: 4) 10:10:53.572232 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:10:53.784532 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:10:54.103052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7460): Launched 10:10:54.378732 run iperf3-srv_10.42.42.10(pid=7461): Launched 10:10:54.497835 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:10:54.707688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:10:55.023827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7462): Launched 10:10:55.298484 run iperf3-srv_10.42.42.10(pid=7463): Launched 10:10:55.417073 tst cs_paging_gprs_active.py:38: start network... 10:10:55.625787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:56.111819 run create_hlr_db(pid=7464): Launched 10:10:56.241559 bus /sierra_2: Setting Powered False 10:10:57.303034 run create_hlr_db(pid=7464): Terminated: ok {rc=0} 10:10:57.740110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7466): Launched 10:10:58.056193 run osmo-hlr_10.42.42.2(pid=7467): Launched 10:10:58.176765 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:58.714191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7469): Launched 10:10:59.028385 run osmo-stp_10.42.42.5(pid=7470): Launched 10:10:59.149003 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:11:00.664127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7472): Launched 10:11:00.784894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:11:01.089590 run patchelf(pid=7473): Launched 10:11:01.296235 run osmo-stp_10.42.42.5(pid=7470): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7470)] 10:11:01.430769 run osmo-stp_10.42.42.5(pid=7470): stdout: | (launched: 2022-12-13_10:10:58.969560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:01.566722 run osmo-stp_10.42.42.5(pid=7470): stderr: | 20221213101059141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101059141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101059141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101059141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101059143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101059143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101059143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:01.703616 run osmo-stp_10.42.42.5(pid=7470): stdout: | (launched: 2022-12-13_10:10:58.969560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:01.834138 run osmo-stp_10.42.42.5(pid=7470): stderr: | 20221213101059141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101059141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101059141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101059141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101059143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101059143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101059143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:01.989515 run patchelf(pid=7473): Terminating (SIGINT) 10:11:02.169953 run patchelf(pid=7473): Terminated: ok {rc=0} 10:11:02.297786 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7470): Process ended prematurely: osmo-stp_10.42.42.5(pid=7470) [trial-2388↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7470)] [trial-2388↪gprs:sysmo↪cs_paging_gprs_active.py:38] 10:11:02.307099 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 10:11:02.334207 run osmo-hlr_10.42.42.2(pid=7467): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7467)] 10:11:02.382055 run osmo-hlr_10.42.42.2(pid=7467): stdout: | (launched: 2022-12-13_10:10:57.997098) 10:11:02.431435 run osmo-hlr_10.42.42.2(pid=7467): stderr: | 20221213101058177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101058177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101058177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101058177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101058177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101058177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101058188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101058196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101058197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101058197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:02.481334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7460): Terminating (SIGTERM) 10:11:02.521351 run iperf3-srv_10.42.42.10(pid=7461): Terminating (SIGTERM) 10:11:02.561573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7462): Terminating (SIGTERM) 10:11:02.601867 run iperf3-srv_10.42.42.10(pid=7463): Terminating (SIGTERM) 10:11:02.641901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7466): Terminating (SIGTERM) 10:11:02.681986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7469): Terminating (SIGTERM) 10:11:02.722104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7472): Terminating (SIGTERM) 10:11:02.762464 --- ParallelTerminationStrategy: PID 7460 died... 10:11:02.781793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7460): Terminated: ok {rc=0} 10:11:02.826164 --- ParallelTerminationStrategy: PID 7461 died... 10:11:02.844825 run iperf3-srv_10.42.42.10(pid=7461): Terminated {rc=256} 10:11:02.889606 --- ParallelTerminationStrategy: PID 7462 died... 10:11:02.909168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7462): Terminated: ok {rc=0} 10:11:02.953496 --- ParallelTerminationStrategy: PID 7463 died... 10:11:02.972295 run iperf3-srv_10.42.42.10(pid=7463): Terminated {rc=256} 10:11:03.016342 --- ParallelTerminationStrategy: PID 7466 died... 10:11:03.035351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7466): Terminated: ok {rc=0} 10:11:03.079602 --- ParallelTerminationStrategy: PID 7469 died... 10:11:03.098318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7469): Terminated: ok {rc=0} 10:11:03.142842 --- ParallelTerminationStrategy: PID 7472 died... 10:11:03.162268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7472): Terminated: ok {rc=0} 10:11:03.248527 bus /gobi_0: Setting Powered False 10:11:04.348686 bus /gobi_0: Setting Powered False 10:11:05.469349 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo iperf3.py ---------------------------------------------- 10:11:06.631219 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:06.643444 tst gprs:sysmo: Using 1 x bts (candidates: 1) 10:11:06.679674 tst iperf3.py: using LAC 33224 10:11:06.804055 tst iperf3.py: using RAC 74 10:11:06.935849 tst iperf3.py: using CellId 33224 10:11:07.067835 tst iperf3.py: using BVCI 33225 10:11:07.191843 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:07.202880 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:07.213827 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:07.224638 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:07.235845 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:07.246924 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:07.258211 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:07.269524 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:07.280828 tst gprs:sysmo: Using 1 x modem (candidates: 4) 10:11:07.403705 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:11:07.630975 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:07.969454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7474): Launched 10:11:08.263238 run iperf3-srv_10.42.42.10(pid=7475): Launched 10:11:08.388746 tst iperf3.py:8: start network... 10:11:08.614897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:09.136277 run create_hlr_db(pid=7476): Launched 10:11:09.264705 bus /gobi_6: Setting Powered False 10:11:10.330597 run create_hlr_db(pid=7476): Terminated: ok {rc=0} 10:11:10.778915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7478): Launched 10:11:11.094459 run osmo-hlr_10.42.42.2(pid=7479): Launched 10:11:11.214201 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:11.751824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7481): Launched 10:11:12.067426 run osmo-stp_10.42.42.5(pid=7482): Launched 10:11:12.187402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:11:12.727426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7484): Launched 10:11:12.847909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:11:13.114242 run patchelf(pid=7485): Launched 10:11:13.287168 run osmo-stp_10.42.42.5(pid=7482): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7482)] 10:11:13.418814 run osmo-stp_10.42.42.5(pid=7482): stdout: | (launched: 2022-12-13_10:11:12.008012) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:13.551646 run osmo-stp_10.42.42.5(pid=7482): stderr: | 20221213101112183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101112183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101112183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101112184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101112184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101112184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101112184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:13.684550 run osmo-stp_10.42.42.5(pid=7482): stdout: | (launched: 2022-12-13_10:11:12.008012) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:13.811969 run osmo-stp_10.42.42.5(pid=7482): stderr: | 20221213101112183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101112183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101112183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101112184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101112184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101112184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101112184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:13.963739 run patchelf(pid=7485): Terminating (SIGINT) 10:11:14.139181 run patchelf(pid=7485): Terminated: ok {rc=0} 10:11:14.265678 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7482): Process ended prematurely: osmo-stp_10.42.42.5(pid=7482) [trial-2388↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7482)] [trial-2388↪gprs:sysmo↪iperf3.py:8] 10:11:14.275101 tst iperf3.py:8: Test FAILED (7.7 sec) 10:11:14.302202 run osmo-hlr_10.42.42.2(pid=7479): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7479)] 10:11:14.350273 run osmo-hlr_10.42.42.2(pid=7479): stdout: | (launched: 2022-12-13_10:11:11.035477) 10:11:14.399943 run osmo-hlr_10.42.42.2(pid=7479): stderr: | 20221213101111217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101111217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101111217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101111217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101111217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101111217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101111244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101111253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101111253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101111253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:14.450164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7474): Terminating (SIGTERM) 10:11:14.490288 run iperf3-srv_10.42.42.10(pid=7475): Terminating (SIGTERM) 10:11:14.530187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7478): Terminating (SIGTERM) 10:11:14.570120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7481): Terminating (SIGTERM) 10:11:14.610026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7484): Terminating (SIGTERM) 10:11:14.650286 --- ParallelTerminationStrategy: PID 7474 died... 10:11:14.669605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7474): Terminated: ok {rc=0} 10:11:14.713908 --- ParallelTerminationStrategy: PID 7475 died... 10:11:14.732669 run iperf3-srv_10.42.42.10(pid=7475): Terminated {rc=256} 10:11:14.776844 --- ParallelTerminationStrategy: PID 7478 died... 10:11:14.796124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7478): Terminated: ok {rc=0} 10:11:14.840484 --- ParallelTerminationStrategy: PID 7481 died... 10:11:14.859403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7481): Terminated: ok {rc=0} 10:11:14.903586 --- ParallelTerminationStrategy: PID 7484 died... 10:11:14.922366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7484): Terminated: ok {rc=0} 10:11:15.008917 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo iperf3m4.py ---------------------------------------------- 10:11:16.197304 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:16.213789 tst gprs:sysmo: Using 1 x bts (candidates: 1) 10:11:16.261013 tst iperf3m4.py: using LAC 33225 10:11:16.384927 tst iperf3m4.py: using RAC 75 10:11:16.518183 tst iperf3m4.py: using CellId 33225 10:11:16.682367 tst iperf3m4.py: using BVCI 33226 10:11:16.822266 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:16.834019 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:16.845887 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:16.857637 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:16.870195 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:16.882628 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:16.895288 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:16.907702 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:16.920394 tst gprs:sysmo: Using 1 x modem (candidates: 4) 10:11:17.058373 tst gprs:sysmo: Using 1 x modem (candidates: 4) 10:11:17.212760 tst gprs:sysmo: Using 1 x modem (candidates: 4) 10:11:17.330498 tst gprs:sysmo: Using 1 x modem (candidates: 4) 10:11:17.449676 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:11:17.660404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:17.976104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7486): Launched 10:11:18.252620 run iperf3-srv_10.42.42.10(pid=7487): Launched 10:11:18.372809 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:11:18.582337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:18.898183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7488): Launched 10:11:19.173612 run iperf3-srv_10.42.42.10(pid=7489): Launched 10:11:19.292277 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:11:19.500845 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:19.815123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7490): Launched 10:11:20.090504 run iperf3-srv_10.42.42.10(pid=7491): Launched 10:11:20.209704 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:11:20.418999 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:20.734350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7492): Launched 10:11:21.026853 run iperf3-srv_10.42.42.10(pid=7493): Launched 10:11:21.146433 tst iperf3m4.py:8: start network... 10:11:21.356516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:21.845236 run create_hlr_db(pid=7494): Launched 10:11:21.974480 bus /gobi_6: Setting Powered False 10:11:23.036668 run create_hlr_db(pid=7494): Terminated: ok {rc=0} 10:11:23.495561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7496): Launched 10:11:23.834769 run osmo-hlr_10.42.42.2(pid=7497): Launched 10:11:23.963556 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:24.543037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7499): Launched 10:11:24.879559 run osmo-stp_10.42.42.5(pid=7500): Launched 10:11:25.008232 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:11:25.587842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7502): Launched 10:11:25.716106 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:11:26.001231 run patchelf(pid=7503): Launched 10:11:26.189047 run osmo-stp_10.42.42.5(pid=7500): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7500)] 10:11:26.330979 run osmo-stp_10.42.42.5(pid=7500): stdout: | (launched: 2022-12-13_10:11:24.816619) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:26.474152 run osmo-stp_10.42.42.5(pid=7500): stderr: | 20221213101125008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101125008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101125008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101125008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101125009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101125009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101125009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:26.617685 run osmo-stp_10.42.42.5(pid=7500): stdout: | (launched: 2022-12-13_10:11:24.816619) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:26.755281 run osmo-stp_10.42.42.5(pid=7500): stderr: | 20221213101125008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101125008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101125008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101125008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101125009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101125009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101125009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:26.918430 run patchelf(pid=7503): Terminating (SIGINT) 10:11:27.107640 run patchelf(pid=7503): Terminated: ok {rc=0} 10:11:27.243701 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7500): Process ended prematurely: osmo-stp_10.42.42.5(pid=7500) [trial-2388↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7500)] [trial-2388↪gprs:sysmo↪iperf3m4.py:8] 10:11:27.254097 tst iperf3m4.py:8: Test FAILED (11.1 sec) 10:11:27.283266 run osmo-hlr_10.42.42.2(pid=7497): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7497)] 10:11:27.335324 run osmo-hlr_10.42.42.2(pid=7497): stdout: | (launched: 2022-12-13_10:11:23.771976) 10:11:27.388429 run osmo-hlr_10.42.42.2(pid=7497): stderr: | 20221213101123968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101123968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101123968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101123968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101123968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101123968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101123980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101123989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101123989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101123989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:27.441997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7486): Terminating (SIGTERM) 10:11:27.484401 run iperf3-srv_10.42.42.10(pid=7487): Terminating (SIGTERM) 10:11:27.527495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7488): Terminating (SIGTERM) 10:11:27.570354 run iperf3-srv_10.42.42.10(pid=7489): Terminating (SIGTERM) 10:11:27.612648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7490): Terminating (SIGTERM) 10:11:27.655446 run iperf3-srv_10.42.42.10(pid=7491): Terminating (SIGTERM) 10:11:27.697948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7492): Terminating (SIGTERM) 10:11:27.740488 run iperf3-srv_10.42.42.10(pid=7493): Terminating (SIGTERM) 10:11:27.783502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7496): Terminating (SIGTERM) 10:11:27.826429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7499): Terminating (SIGTERM) 10:11:27.869220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7502): Terminating (SIGTERM) 10:11:27.911985 --- ParallelTerminationStrategy: PID 7486 died... 10:11:27.932920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7486): Terminated: ok {rc=0} 10:11:27.980399 --- ParallelTerminationStrategy: PID 7487 died... 10:11:28.000620 run iperf3-srv_10.42.42.10(pid=7487): Terminated {rc=256} 10:11:28.048189 --- ParallelTerminationStrategy: PID 7488 died... 10:11:28.068490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7488): Terminated: ok {rc=0} 10:11:28.115804 --- ParallelTerminationStrategy: PID 7489 died... 10:11:28.136063 run iperf3-srv_10.42.42.10(pid=7489): Terminated {rc=256} 10:11:28.183220 --- ParallelTerminationStrategy: PID 7490 died... 10:11:28.203892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7490): Terminated: ok {rc=0} 10:11:28.251010 --- ParallelTerminationStrategy: PID 7491 died... 10:11:28.271229 run iperf3-srv_10.42.42.10(pid=7491): Terminated {rc=256} 10:11:28.318095 --- ParallelTerminationStrategy: PID 7492 died... 10:11:28.338336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7492): Terminated: ok {rc=0} 10:11:28.385415 --- ParallelTerminationStrategy: PID 7493 died... 10:11:28.405628 run iperf3-srv_10.42.42.10(pid=7493): Terminated {rc=256} 10:11:28.452413 --- ParallelTerminationStrategy: PID 7496 died... 10:11:28.472641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7496): Terminated: ok {rc=0} 10:11:28.519702 --- ParallelTerminationStrategy: PID 7499 died... 10:11:28.540061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7499): Terminated: ok {rc=0} 10:11:28.587133 --- ParallelTerminationStrategy: PID 7502 died... 10:11:28.607504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7502): Terminated: ok {rc=0} 10:11:28.697149 bus /gobi_4: Setting Powered False 10:11:29.797862 bus /gobi_4: Setting Powered False 10:11:30.925249 bus /gobi_1: Setting Powered False 10:11:32.038577 bus /gobi_1: Setting Powered False 10:11:33.169027 bus /gobi_0: Setting Powered False 10:11:34.266502 bus /gobi_0: Setting Powered False 10:11:35.384512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo ping.py ---------------------------------------------- 10:11:36.489441 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:36.500717 tst gprs:sysmo: Using 1 x bts (candidates: 1) 10:11:36.539979 tst ping.py: using LAC 33226 10:11:36.661983 tst ping.py: using RAC 76 10:11:36.782995 tst ping.py: using CellId 33226 10:11:36.904473 tst ping.py: using BVCI 33227 10:11:37.015843 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:37.026627 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:37.037432 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:37.048143 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:37.058773 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:37.069845 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:37.080414 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:37.090995 tst gprs:sysmo: Using 1 x modem (candidates: 4) 10:11:37.211754 tst ping.py:19: start network... 10:11:37.417855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:37.931073 run create_hlr_db(pid=7504): Launched 10:11:38.057747 bus /gobi_6: Setting Powered False 10:11:39.123179 run create_hlr_db(pid=7504): Terminated: ok {rc=0} 10:11:39.584647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7506): Launched 10:11:39.917346 run osmo-hlr_10.42.42.2(pid=7507): Launched 10:11:40.046020 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:40.616896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7509): Launched 10:11:40.948653 run osmo-stp_10.42.42.5(pid=7510): Launched 10:11:41.075942 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:11:41.646184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7512): Launched 10:11:41.771976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:11:42.053133 run patchelf(pid=7513): Launched 10:11:42.237520 run osmo-stp_10.42.42.5(pid=7510): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7510)] 10:11:42.377269 run osmo-stp_10.42.42.5(pid=7510): stdout: | (launched: 2022-12-13_10:11:40.886720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:42.518413 run osmo-stp_10.42.42.5(pid=7510): stderr: | 20221213101141076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101141076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101141076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101141077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101141077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101141077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101141077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:42.659872 run osmo-stp_10.42.42.5(pid=7510): stdout: | (launched: 2022-12-13_10:11:40.886720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:42.795454 run osmo-stp_10.42.42.5(pid=7510): stderr: | 20221213101141076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101141076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101141076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101141077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101141077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101141077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101141077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:42.956111 run patchelf(pid=7513): Terminating (SIGINT) 10:11:43.141515 run patchelf(pid=7513): Terminated: ok {rc=0} 10:11:43.274625 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7510): Process ended prematurely: osmo-stp_10.42.42.5(pid=7510) [trial-2388↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7510)] [trial-2388↪gprs:sysmo↪ping.py:22] 10:11:43.284180 tst ping.py:22: Test FAILED (6.8 sec) 10:11:43.312613 run osmo-hlr_10.42.42.2(pid=7507): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7507)] 10:11:43.364021 run osmo-hlr_10.42.42.2(pid=7507): stdout: | (launched: 2022-12-13_10:11:39.855307) 10:11:43.417469 run osmo-hlr_10.42.42.2(pid=7507): stderr: | 20221213101140060 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101140060 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101140060 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101140060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101140060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101140060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101140072 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101140082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101140082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101140082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:43.470535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7506): Terminating (SIGTERM) 10:11:43.513478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7509): Terminating (SIGTERM) 10:11:43.556572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7512): Terminating (SIGTERM) 10:11:43.599771 --- ParallelTerminationStrategy: PID 7506 died... 10:11:43.620265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7506): Terminated: ok {rc=0} 10:11:43.667880 --- ParallelTerminationStrategy: PID 7509 died... 10:11:43.687994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7509): Terminated: ok {rc=0} 10:11:43.735398 --- ParallelTerminationStrategy: PID 7512 died... 10:11:43.755653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7512): Terminated: ok {rc=0} 10:11:43.845221 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 10:11:44.932555 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:44.944523 tst gprs:sysmo: Using 1 x bts (candidates: 1) 10:11:44.983023 tst ping_idle_ping.py: using LAC 33227 10:11:45.106579 tst ping_idle_ping.py: using RAC 77 10:11:45.229790 tst ping_idle_ping.py: using CellId 33227 10:11:45.360147 tst ping_idle_ping.py: using BVCI 33228 10:11:45.479698 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:45.490958 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:45.502122 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:45.513548 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:45.524857 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:45.536165 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:45.547663 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 10:11:45.559073 tst gprs:sysmo: Using 1 x modem (candidates: 4) 10:11:45.684438 tst ping_idle_ping.py:24: start network... 10:11:45.924050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:46.453654 run create_hlr_db(pid=7514): Launched 10:11:46.614857 bus /gobi_6: Setting Powered False 10:11:47.675873 run create_hlr_db(pid=7514): Terminated: ok {rc=0} 10:11:48.106416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7516): Launched 10:11:48.416109 run osmo-hlr_10.42.42.2(pid=7517): Launched 10:11:48.534157 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:49.063589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7519): Launched 10:11:49.374206 run osmo-stp_10.42.42.5(pid=7520): Launched 10:11:49.490169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:11:50.022771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7522): Launched 10:11:50.142059 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:11:50.404878 run patchelf(pid=7523): Launched 10:11:50.576887 run osmo-stp_10.42.42.5(pid=7520): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7520)] 10:11:50.706828 run osmo-stp_10.42.42.5(pid=7520): stdout: | (launched: 2022-12-13_10:11:49.315987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:50.838334 run osmo-stp_10.42.42.5(pid=7520): stderr: | 20221213101149486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101149487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101149487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101149487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101149488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101149488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101149488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:50.969604 run osmo-stp_10.42.42.5(pid=7520): stdout: | (launched: 2022-12-13_10:11:49.315987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:51.095678 run osmo-stp_10.42.42.5(pid=7520): stderr: | 20221213101149486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101149487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101149487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101149487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101149488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101149488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101149488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:51.244655 run patchelf(pid=7523): Terminating (SIGINT) 10:11:51.418483 run patchelf(pid=7523): Terminated: ok {rc=0} 10:11:51.542875 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7520): Process ended prematurely: osmo-stp_10.42.42.5(pid=7520) [trial-2388↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7520)] [trial-2388↪gprs:sysmo↪ping_idle_ping.py:27] 10:11:51.551729 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:11:51.578368 run osmo-hlr_10.42.42.2(pid=7517): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7517)] 10:11:51.626332 run osmo-hlr_10.42.42.2(pid=7517): stdout: | (launched: 2022-12-13_10:11:48.357618) 10:11:51.675587 run osmo-hlr_10.42.42.2(pid=7517): stderr: | 20221213101148536 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101148536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101148536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101148536 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101148536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101148536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101148549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101148558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101148558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101148558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:51.725730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7516): Terminating (SIGTERM) 10:11:51.765649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7519): Terminating (SIGTERM) 10:11:51.805435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7522): Terminating (SIGTERM) 10:11:51.845682 --- ParallelTerminationStrategy: PID 7516 died... 10:11:51.865215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7516): Terminated: ok {rc=0} 10:11:51.911127 --- ParallelTerminationStrategy: PID 7519 died... 10:11:51.930166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7519): Terminated: ok {rc=0} 10:11:51.974719 --- ParallelTerminationStrategy: PID 7522 died... 10:11:51.993843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7522): Terminated: ok {rc=0} 10:11:52.081311 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 10:11:53.373065 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:11:53.378709 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:11:53.400033 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:11:53.441215 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:11:53.531300 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:11:53.552530 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:11:53.592405 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:11:54.186859 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:11:54.242407 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:54.253690 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:11:54.290654 tst cs_paging_gprs_active.py: using LAC 33228 10:11:54.423856 tst cs_paging_gprs_active.py: using RAC 78 10:11:54.556776 tst cs_paging_gprs_active.py: using CellId 33228 10:11:54.690101 tst cs_paging_gprs_active.py: using BVCI 33229 10:11:54.815078 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:54.826493 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:54.837615 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:54.848604 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:54.859887 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:54.871258 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:54.882951 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:54.894328 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:54.906066 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:11:55.027688 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:11:55.150602 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:11:55.380329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:55.720396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7527): Launched 10:11:56.015078 run iperf3-srv_10.42.42.10(pid=7528): Launched 10:11:56.141614 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:11:56.369151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:56.708905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7529): Launched 10:11:57.004545 run iperf3-srv_10.42.42.10(pid=7530): Launched 10:11:57.131663 tst cs_paging_gprs_active.py:38: start network... 10:11:57.360389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:57.884295 run create_hlr_db(pid=7531): Launched 10:11:58.014462 bus /gobi_6: Setting Powered False 10:11:59.080653 run create_hlr_db(pid=7531): Terminated: ok {rc=0} 10:11:59.530826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7533): Launched 10:11:59.847110 run osmo-hlr_10.42.42.2(pid=7534): Launched 10:11:59.967120 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:00.521162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7536): Launched 10:12:00.835597 run osmo-stp_10.42.42.5(pid=7537): Launched 10:12:01.105194 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:12:01.704265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7539): Launched 10:12:01.842339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:12:02.114373 run patchelf(pid=7540): Launched 10:12:02.305208 run osmo-stp_10.42.42.5(pid=7537): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7537)] 10:12:02.437748 run osmo-stp_10.42.42.5(pid=7537): stdout: | (launched: 2022-12-13_10:12:00.776262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:02.572505 run osmo-stp_10.42.42.5(pid=7537): stderr: | 20221213101201003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101201003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101201003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101201003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101201004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101201004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101201004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:02.706361 run osmo-stp_10.42.42.5(pid=7537): stdout: | (launched: 2022-12-13_10:12:00.776262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:02.834477 run osmo-stp_10.42.42.5(pid=7537): stderr: | 20221213101201003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101201003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101201003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101201003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101201004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101201004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101201004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:02.986489 run patchelf(pid=7540): Terminating (SIGINT) 10:12:03.162861 run patchelf(pid=7540): Terminated: ok {rc=0} 10:12:03.290328 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7537): Process ended prematurely: osmo-stp_10.42.42.5(pid=7537) [trial-2388↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7537)] [trial-2388↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:12:03.299859 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 10:12:03.327346 run osmo-hlr_10.42.42.2(pid=7534): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7534)] 10:12:03.376295 run osmo-hlr_10.42.42.2(pid=7534): stdout: | (launched: 2022-12-13_10:11:59.787976) 10:12:03.426755 run osmo-hlr_10.42.42.2(pid=7534): stderr: | 20221213101159967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101159968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101159968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101159968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101159968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101159968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101159980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101159988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101159989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101159989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:03.477341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7527): Terminating (SIGTERM) 10:12:03.517990 run iperf3-srv_10.42.42.10(pid=7528): Terminating (SIGTERM) 10:12:03.558549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7529): Terminating (SIGTERM) 10:12:03.599049 run iperf3-srv_10.42.42.10(pid=7530): Terminating (SIGTERM) 10:12:03.639300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7533): Terminating (SIGTERM) 10:12:03.679629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7536): Terminating (SIGTERM) 10:12:03.719905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7539): Terminating (SIGTERM) 10:12:03.760568 --- ParallelTerminationStrategy: PID 7527 died... 10:12:03.780028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7527): Terminated: ok {rc=0} 10:12:03.824684 --- ParallelTerminationStrategy: PID 7528 died... 10:12:03.843451 run iperf3-srv_10.42.42.10(pid=7528): Terminated {rc=256} 10:12:03.887668 --- ParallelTerminationStrategy: PID 7529 died... 10:12:03.906399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7529): Terminated: ok {rc=0} 10:12:03.950376 --- ParallelTerminationStrategy: PID 7530 died... 10:12:03.968883 run iperf3-srv_10.42.42.10(pid=7530): Terminated {rc=256} 10:12:04.013121 --- ParallelTerminationStrategy: PID 7533 died... 10:12:04.031785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7533): Terminated: ok {rc=0} 10:12:04.076120 --- ParallelTerminationStrategy: PID 7536 died... 10:12:04.095027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7536): Terminated: ok {rc=0} 10:12:04.139688 --- ParallelTerminationStrategy: PID 7539 died... 10:12:04.158530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7539): Terminated: ok {rc=0} 10:12:04.245859 bus /gobi_0: Setting Powered False 10:12:05.347395 bus /gobi_0: Setting Powered False 10:12:06.465195 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:12:07.614621 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:07.626104 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:12:07.662122 tst iperf3.py: using LAC 33229 10:12:07.785069 tst iperf3.py: using RAC 79 10:12:07.909205 tst iperf3.py: using CellId 33229 10:12:08.033498 tst iperf3.py: using BVCI 33230 10:12:08.148773 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:08.159593 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:08.170720 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:08.181337 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:08.191820 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:08.202839 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:08.213615 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:08.224170 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:08.234960 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:12:08.358660 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:12:08.587368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:08.927089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7541): Launched 10:12:09.220359 run iperf3-srv_10.42.42.10(pid=7542): Launched 10:12:09.348055 tst iperf3.py:8: start network... 10:12:09.575218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:10.097488 run create_hlr_db(pid=7543): Launched 10:12:10.227637 bus /gobi_6: Setting Powered False 10:12:11.292925 run create_hlr_db(pid=7543): Terminated: ok {rc=0} 10:12:11.742703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7545): Launched 10:12:12.058624 run osmo-hlr_10.42.42.2(pid=7546): Launched 10:12:12.178520 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:12.730134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7548): Launched 10:12:13.044012 run osmo-stp_10.42.42.5(pid=7549): Launched 10:12:13.163318 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:12:13.705921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7551): Launched 10:12:13.825271 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:12:14.090999 run patchelf(pid=7552): Launched 10:12:14.265503 run osmo-stp_10.42.42.5(pid=7549): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7549)] 10:12:14.397778 run osmo-stp_10.42.42.5(pid=7549): stdout: | (launched: 2022-12-13_10:12:12.985072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:14.530957 run osmo-stp_10.42.42.5(pid=7549): stderr: | 20221213101213160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101213160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101213161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101213161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101213162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101213162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101213162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:14.664127 run osmo-stp_10.42.42.5(pid=7549): stdout: | (launched: 2022-12-13_10:12:12.985072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:14.791778 run osmo-stp_10.42.42.5(pid=7549): stderr: | 20221213101213160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101213160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101213161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101213161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101213162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101213162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101213162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:14.943044 run patchelf(pid=7552): Terminating (SIGINT) 10:12:15.118336 run patchelf(pid=7552): Terminated: ok {rc=0} 10:12:15.245473 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7549): Process ended prematurely: osmo-stp_10.42.42.5(pid=7549) [trial-2388↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7549)] [trial-2388↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 10:12:15.254899 tst iperf3.py:8: Test FAILED (7.7 sec) 10:12:15.282052 run osmo-hlr_10.42.42.2(pid=7546): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7546)] 10:12:15.330263 run osmo-hlr_10.42.42.2(pid=7546): stdout: | (launched: 2022-12-13_10:12:11.999546) 10:12:15.380062 run osmo-hlr_10.42.42.2(pid=7546): stderr: | 20221213101212179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101212179 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101212179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101212179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101212179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101212180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101212191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101212200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101212200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101212200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:15.430323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7541): Terminating (SIGTERM) 10:12:15.470838 run iperf3-srv_10.42.42.10(pid=7542): Terminating (SIGTERM) 10:12:15.512368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7545): Terminating (SIGTERM) 10:12:15.553417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7548): Terminating (SIGTERM) 10:12:15.593193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7551): Terminating (SIGTERM) 10:12:15.633132 --- ParallelTerminationStrategy: PID 7541 died... 10:12:15.652209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7541): Terminated: ok {rc=0} 10:12:15.696380 --- ParallelTerminationStrategy: PID 7542 died... 10:12:15.714976 run iperf3-srv_10.42.42.10(pid=7542): Terminated {rc=256} 10:12:15.758703 --- ParallelTerminationStrategy: PID 7545 died... 10:12:15.777355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7545): Terminated: ok {rc=0} 10:12:15.821405 --- ParallelTerminationStrategy: PID 7548 died... 10:12:15.839936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7548): Terminated: ok {rc=0} 10:12:15.886093 --- ParallelTerminationStrategy: PID 7551 died... 10:12:15.907685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7551): Terminated: ok {rc=0} 10:12:15.996577 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:12:17.171495 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:17.184609 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:12:17.224605 tst iperf3m4.py: using LAC 33230 10:12:17.355607 tst iperf3m4.py: using RAC 80 10:12:17.477365 tst iperf3m4.py: using CellId 33230 10:12:17.600416 tst iperf3m4.py: using BVCI 33231 10:12:17.715228 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:17.726080 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:17.736714 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:17.747379 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:17.758028 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:17.768499 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:17.779213 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:17.789693 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:17.801084 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:12:17.920050 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:12:18.045709 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:12:18.165037 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:12:18.287189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:12:18.515281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:18.856533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7553): Launched 10:12:19.152048 run iperf3-srv_10.42.42.10(pid=7554): Launched 10:12:19.278026 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:12:19.504377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:19.843079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7555): Launched 10:12:20.137140 run iperf3-srv_10.42.42.10(pid=7556): Launched 10:12:20.264083 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:12:20.490786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:20.829593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7557): Launched 10:12:21.124529 run iperf3-srv_10.42.42.10(pid=7558): Launched 10:12:21.251813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:12:21.478531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:21.817543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7559): Launched 10:12:22.112765 run iperf3-srv_10.42.42.10(pid=7560): Launched 10:12:22.239974 tst iperf3m4.py:8: start network... 10:12:22.466675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:22.988240 run create_hlr_db(pid=7561): Launched 10:12:23.117890 bus /gobi_6: Setting Powered False 10:12:24.183854 run create_hlr_db(pid=7561): Terminated: ok {rc=0} 10:12:24.632548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7563): Launched 10:12:24.946542 run osmo-hlr_10.42.42.2(pid=7564): Launched 10:12:25.066687 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:25.607752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7566): Launched 10:12:25.924638 run osmo-stp_10.42.42.5(pid=7567): Launched 10:12:26.044675 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:12:26.584807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7569): Launched 10:12:26.705874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:12:26.971958 run patchelf(pid=7570): Launched 10:12:27.147051 run osmo-stp_10.42.42.5(pid=7567): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7567)] 10:12:27.279456 run osmo-stp_10.42.42.5(pid=7567): stdout: | (launched: 2022-12-13_10:12:25.865065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:27.413166 run osmo-stp_10.42.42.5(pid=7567): stderr: | 20221213101226038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101226038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101226039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101226039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101226039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101226040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101226040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:27.546947 run osmo-stp_10.42.42.5(pid=7567): stdout: | (launched: 2022-12-13_10:12:25.865065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:27.676040 run osmo-stp_10.42.42.5(pid=7567): stderr: | 20221213101226038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101226038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101226039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101226039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101226039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101226040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101226040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:27.827652 run patchelf(pid=7570): Terminating (SIGINT) 10:12:28.002824 run patchelf(pid=7570): Terminated: ok {rc=0} 10:12:28.130432 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7567): Process ended prematurely: osmo-stp_10.42.42.5(pid=7567) [trial-2388↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7567)] [trial-2388↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 10:12:28.139886 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:12:28.167494 run osmo-hlr_10.42.42.2(pid=7564): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7564)] 10:12:28.215925 run osmo-hlr_10.42.42.2(pid=7564): stdout: | (launched: 2022-12-13_10:12:24.887086) 10:12:28.265847 run osmo-hlr_10.42.42.2(pid=7564): stderr: | 20221213101225065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101225065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101225065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101225065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101225065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101225065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101225077 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101225087 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101225087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101225087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:28.316128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7553): Terminating (SIGTERM) 10:12:28.356410 run iperf3-srv_10.42.42.10(pid=7554): Terminating (SIGTERM) 10:12:28.396636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7555): Terminating (SIGTERM) 10:12:28.437021 run iperf3-srv_10.42.42.10(pid=7556): Terminating (SIGTERM) 10:12:28.477065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7557): Terminating (SIGTERM) 10:12:28.517390 run iperf3-srv_10.42.42.10(pid=7558): Terminating (SIGTERM) 10:12:28.557524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7559): Terminating (SIGTERM) 10:12:28.597613 run iperf3-srv_10.42.42.10(pid=7560): Terminating (SIGTERM) 10:12:28.638290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7563): Terminating (SIGTERM) 10:12:28.678478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7566): Terminating (SIGTERM) 10:12:28.718740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7569): Terminating (SIGTERM) 10:12:28.759240 --- ParallelTerminationStrategy: PID 7553 died... 10:12:28.778659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7553): Terminated: ok {rc=0} 10:12:28.823051 --- ParallelTerminationStrategy: PID 7554 died... 10:12:28.841756 run iperf3-srv_10.42.42.10(pid=7554): Terminated {rc=256} 10:12:28.885758 --- ParallelTerminationStrategy: PID 7555 died... 10:12:28.904605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7555): Terminated: ok {rc=0} 10:12:28.948667 --- ParallelTerminationStrategy: PID 7556 died... 10:12:28.967371 run iperf3-srv_10.42.42.10(pid=7556): Terminated {rc=256} 10:12:29.011377 --- ParallelTerminationStrategy: PID 7557 died... 10:12:29.030159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7557): Terminated: ok {rc=0} 10:12:29.074331 --- ParallelTerminationStrategy: PID 7558 died... 10:12:29.093155 run iperf3-srv_10.42.42.10(pid=7558): Terminated {rc=256} 10:12:29.137438 --- ParallelTerminationStrategy: PID 7559 died... 10:12:29.156286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7559): Terminated: ok {rc=0} 10:12:29.200395 --- ParallelTerminationStrategy: PID 7560 died... 10:12:29.219141 run iperf3-srv_10.42.42.10(pid=7560): Terminated {rc=256} 10:12:29.263291 --- ParallelTerminationStrategy: PID 7563 died... 10:12:29.282190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7563): Terminated: ok {rc=0} 10:12:29.326377 --- ParallelTerminationStrategy: PID 7566 died... 10:12:29.345305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7566): Terminated: ok {rc=0} 10:12:29.389522 --- ParallelTerminationStrategy: PID 7569 died... 10:12:29.408414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7569): Terminated: ok {rc=0} 10:12:29.495339 bus /gobi_4: Setting Powered False 10:12:30.595626 bus /gobi_4: Setting Powered False 10:12:31.738754 bus /gobi_1: Setting Powered False 10:12:32.843229 bus /gobi_1: Setting Powered False 10:12:33.960343 bus /gobi_0: Setting Powered False 10:12:35.058499 bus /gobi_0: Setting Powered False 10:12:36.173350 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 10:12:37.278140 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:37.290253 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:12:37.328406 tst ping.py: using LAC 33231 10:12:37.449881 tst ping.py: using RAC 81 10:12:37.572483 tst ping.py: using CellId 33231 10:12:37.696047 tst ping.py: using BVCI 33232 10:12:37.809925 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:37.820752 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:37.831708 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:37.842597 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:37.853243 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:37.864041 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:37.874828 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:37.885534 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:12:38.008874 tst ping.py:19: start network... 10:12:38.234754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:38.749851 run create_hlr_db(pid=7571): Launched 10:12:38.877436 bus /gobi_6: Setting Powered False 10:12:39.942272 run create_hlr_db(pid=7571): Terminated: ok {rc=0} 10:12:40.389658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7573): Launched 10:12:40.699170 run osmo-hlr_10.42.42.2(pid=7574): Launched 10:12:40.817288 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:41.352278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7576): Launched 10:12:41.663799 run osmo-stp_10.42.42.5(pid=7577): Launched 10:12:41.782648 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:12:42.314411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7579): Launched 10:12:42.433930 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:12:42.695438 run patchelf(pid=7580): Launched 10:12:42.867448 run osmo-stp_10.42.42.5(pid=7577): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7577)] 10:12:42.997139 run osmo-stp_10.42.42.5(pid=7577): stdout: | (launched: 2022-12-13_10:12:41.604771) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:43.128420 run osmo-stp_10.42.42.5(pid=7577): stderr: | 20221213101241777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101241777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101241777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101241777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101241778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101241778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101241778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:43.259321 run osmo-stp_10.42.42.5(pid=7577): stdout: | (launched: 2022-12-13_10:12:41.604771) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:43.384837 run osmo-stp_10.42.42.5(pid=7577): stderr: | 20221213101241777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101241777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101241777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101241777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101241778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101241778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101241778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:43.534028 run patchelf(pid=7580): Terminating (SIGINT) 10:12:43.707223 run patchelf(pid=7580): Terminated: ok {rc=0} 10:12:43.831706 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7577): Process ended prematurely: osmo-stp_10.42.42.5(pid=7577) [trial-2388↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7577)] [trial-2388↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 10:12:43.840609 tst ping.py:22: Test FAILED (6.6 sec) 10:12:43.867562 run osmo-hlr_10.42.42.2(pid=7574): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7574)] 10:12:43.916042 run osmo-hlr_10.42.42.2(pid=7574): stdout: | (launched: 2022-12-13_10:12:40.640700) 10:12:43.965910 run osmo-hlr_10.42.42.2(pid=7574): stderr: | 20221213101240821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101240821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101240821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101240821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101240821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101240821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101240833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101240842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101240842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101240842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:44.016298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7573): Terminating (SIGTERM) 10:12:44.056639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7576): Terminating (SIGTERM) 10:12:44.097206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7579): Terminating (SIGTERM) 10:12:44.137981 --- ParallelTerminationStrategy: PID 7573 died... 10:12:44.157745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7573): Terminated: ok {rc=0} 10:12:44.202777 --- ParallelTerminationStrategy: PID 7576 died... 10:12:44.222096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7576): Terminated: ok {rc=0} 10:12:44.266904 --- ParallelTerminationStrategy: PID 7579 died... 10:12:44.286129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7579): Terminated: ok {rc=0} 10:12:44.371299 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:12:45.458980 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:45.471585 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:12:45.511551 tst ping_idle_ping.py: using LAC 33232 10:12:45.642653 tst ping_idle_ping.py: using RAC 82 10:12:45.773162 tst ping_idle_ping.py: using CellId 33232 10:12:45.914868 tst ping_idle_ping.py: using BVCI 33233 10:12:46.042021 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:46.054087 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:46.066139 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:46.078605 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:46.090849 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:46.102881 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:46.115157 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:46.127486 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:12:46.258256 tst ping_idle_ping.py:24: start network... 10:12:46.472292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:46.965403 run create_hlr_db(pid=7581): Launched 10:12:47.127403 bus /gobi_6: Setting Powered False 10:12:48.188642 run create_hlr_db(pid=7581): Terminated: ok {rc=0} 10:12:48.621454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7583): Launched 10:12:48.931252 run osmo-hlr_10.42.42.2(pid=7584): Launched 10:12:49.049439 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:49.586751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7586): Launched 10:12:49.897026 run osmo-stp_10.42.42.5(pid=7587): Launched 10:12:50.014930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:12:50.550197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7589): Launched 10:12:50.669670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:12:50.931721 run patchelf(pid=7590): Launched 10:12:51.104587 run osmo-stp_10.42.42.5(pid=7587): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7587)] 10:12:51.235081 run osmo-stp_10.42.42.5(pid=7587): stdout: | (launched: 2022-12-13_10:12:49.838700) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:51.366949 run osmo-stp_10.42.42.5(pid=7587): stderr: | 20221213101250012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101250012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101250012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101250013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101250013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101250013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101250013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:51.498543 run osmo-stp_10.42.42.5(pid=7587): stdout: | (launched: 2022-12-13_10:12:49.838700) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:51.624862 run osmo-stp_10.42.42.5(pid=7587): stderr: | 20221213101250012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101250012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101250012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101250013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101250013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101250013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101250013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:51.774687 run patchelf(pid=7590): Terminating (SIGINT) 10:12:51.948407 run patchelf(pid=7590): Terminated: ok {rc=0} 10:12:52.073175 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7587): Process ended prematurely: osmo-stp_10.42.42.5(pid=7587) [trial-2388↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7587)] [trial-2388↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 10:12:52.082176 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:12:52.109048 run osmo-hlr_10.42.42.2(pid=7584): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7584)] 10:12:52.157489 run osmo-hlr_10.42.42.2(pid=7584): stdout: | (launched: 2022-12-13_10:12:48.873064) 10:12:52.207262 run osmo-hlr_10.42.42.2(pid=7584): stderr: | 20221213101249051 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101249051 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101249051 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101249051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101249051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101249051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101249063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101249072 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101249072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101249072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:52.257665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7583): Terminating (SIGTERM) 10:12:52.297820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7586): Terminating (SIGTERM) 10:12:52.337883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7589): Terminating (SIGTERM) 10:12:52.378419 --- ParallelTerminationStrategy: PID 7583 died... 10:12:52.397952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7583): Terminated: ok {rc=0} 10:12:52.442391 --- ParallelTerminationStrategy: PID 7586 died... 10:12:52.461491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7586): Terminated: ok {rc=0} 10:12:52.505964 --- ParallelTerminationStrategy: PID 7589 died... 10:12:52.524920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7589): Terminated: ok {rc=0} 10:12:52.609347 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:12:53.906368 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:12:53.912325 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:12:53.933017 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:12:53.972237 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:12:54.058772 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:12:54.079575 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:12:54.117527 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:12:54.719765 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:12:54.776516 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:54.788088 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:12:54.844747 tst cs_paging_gprs_active.py: using LAC 33233 10:12:54.978121 tst cs_paging_gprs_active.py: using RAC 83 10:12:55.109892 tst cs_paging_gprs_active.py: using CellId 33233 10:12:55.241574 tst cs_paging_gprs_active.py: using BVCI 33234 10:12:55.366667 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:55.378168 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:55.389488 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:55.400670 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:55.412278 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:55.423810 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:55.435473 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:55.446876 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:55.458833 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:12:55.579042 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:12:55.702953 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:12:55.932175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:56.272659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7595): Launched 10:12:56.566986 run iperf3-srv_10.42.42.10(pid=7596): Launched 10:12:56.694020 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:12:56.921576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:57.262006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7597): Launched 10:12:57.558465 run iperf3-srv_10.42.42.10(pid=7598): Launched 10:12:57.686510 tst cs_paging_gprs_active.py:38: start network... 10:12:57.914561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:58.438227 run create_hlr_db(pid=7599): Launched 10:12:58.568445 bus /gobi_6: Setting Powered False 10:12:59.634798 run create_hlr_db(pid=7599): Terminated: ok {rc=0} 10:13:00.084289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7601): Launched 10:13:00.404246 run osmo-hlr_10.42.42.2(pid=7602): Launched 10:13:00.525937 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:01.115786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7604): Launched 10:13:01.449649 run osmo-stp_10.42.42.5(pid=7605): Launched 10:13:01.696136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:02.402684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7607): Launched 10:13:02.522283 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:02.789650 run patchelf(pid=7608): Launched 10:13:02.963383 run osmo-stp_10.42.42.5(pid=7605): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7605)] 10:13:03.095604 run osmo-stp_10.42.42.5(pid=7605): stdout: | (launched: 2022-12-13_10:13:01.388917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:03.229178 run osmo-stp_10.42.42.5(pid=7605): stderr: | 20221213101301712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101301712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101301712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101301713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101301713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101301713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101301714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:03.362517 run osmo-stp_10.42.42.5(pid=7605): stdout: | (launched: 2022-12-13_10:13:01.388917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:03.489998 run osmo-stp_10.42.42.5(pid=7605): stderr: | 20221213101301712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101301712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101301712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101301713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101301713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101301713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101301714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:03.641385 run patchelf(pid=7608): Terminating (SIGINT) 10:13:03.817702 run patchelf(pid=7608): Terminated: ok {rc=0} 10:13:03.945568 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7605): Process ended prematurely: osmo-stp_10.42.42.5(pid=7605) [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7605)] [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:13:03.955053 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 10:13:03.982358 run osmo-hlr_10.42.42.2(pid=7602): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7602)] 10:13:04.030383 run osmo-hlr_10.42.42.2(pid=7602): stdout: | (launched: 2022-12-13_10:13:00.344498) 10:13:04.080073 run osmo-hlr_10.42.42.2(pid=7602): stderr: | 20221213101300523 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101300523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101300523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101300523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101300523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101300523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101300536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101300545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101300546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101300546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:04.130320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7595): Terminating (SIGTERM) 10:13:04.170522 run iperf3-srv_10.42.42.10(pid=7596): Terminating (SIGTERM) 10:13:04.210512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7597): Terminating (SIGTERM) 10:13:04.250520 run iperf3-srv_10.42.42.10(pid=7598): Terminating (SIGTERM) 10:13:04.290525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7601): Terminating (SIGTERM) 10:13:04.330479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7604): Terminating (SIGTERM) 10:13:04.370486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7607): Terminating (SIGTERM) 10:13:04.410889 --- ParallelTerminationStrategy: PID 7595 died... 10:13:04.430162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7595): Terminated: ok {rc=0} 10:13:04.474621 --- ParallelTerminationStrategy: PID 7596 died... 10:13:04.493265 run iperf3-srv_10.42.42.10(pid=7596): Terminated {rc=256} 10:13:04.537309 --- ParallelTerminationStrategy: PID 7597 died... 10:13:04.556198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7597): Terminated: ok {rc=0} 10:13:04.600270 --- ParallelTerminationStrategy: PID 7598 died... 10:13:04.619016 run iperf3-srv_10.42.42.10(pid=7598): Terminated {rc=256} 10:13:04.662967 --- ParallelTerminationStrategy: PID 7601 died... 10:13:04.681746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7601): Terminated: ok {rc=0} 10:13:04.725893 --- ParallelTerminationStrategy: PID 7604 died... 10:13:04.744488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7604): Terminated: ok {rc=0} 10:13:04.788883 --- ParallelTerminationStrategy: PID 7607 died... 10:13:04.808230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7607): Terminated: ok {rc=0} 10:13:04.895614 bus /gobi_0: Setting Powered False 10:13:05.993618 bus /gobi_0: Setting Powered False 10:13:07.109531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:13:08.258436 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:08.270233 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:13:08.329631 tst iperf3.py: using LAC 33234 10:13:08.453447 tst iperf3.py: using RAC 84 10:13:08.577426 tst iperf3.py: using CellId 33234 10:13:08.701395 tst iperf3.py: using BVCI 33235 10:13:08.815795 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:08.826757 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:08.837524 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:08.848214 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:08.858776 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:08.869438 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:08.880188 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:08.890731 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:08.901558 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:13:09.020032 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:13:09.231808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:09.548279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7609): Launched 10:13:09.823000 run iperf3-srv_10.42.42.10(pid=7610): Launched 10:13:09.943165 tst iperf3.py:8: start network... 10:13:10.153044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:10.639485 run create_hlr_db(pid=7611): Launched 10:13:10.769568 bus /gobi_6: Setting Powered False 10:13:11.831411 run create_hlr_db(pid=7611): Terminated: ok {rc=0} 10:13:12.291930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7613): Launched 10:13:12.630781 run osmo-hlr_10.42.42.2(pid=7614): Launched 10:13:12.758027 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:13.339906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7616): Launched 10:13:13.678239 run osmo-stp_10.42.42.5(pid=7617): Launched 10:13:13.806054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:14.386346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7619): Launched 10:13:14.516215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:14.801571 run patchelf(pid=7620): Launched 10:13:14.988161 run osmo-stp_10.42.42.5(pid=7617): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7617)] 10:13:15.129602 run osmo-stp_10.42.42.5(pid=7617): stdout: | (launched: 2022-12-13_10:13:13.615102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:15.272483 run osmo-stp_10.42.42.5(pid=7617): stderr: | 20221213101313807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101313807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101313808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101313808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101313808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101313809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101313809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:15.415259 run osmo-stp_10.42.42.5(pid=7617): stdout: | (launched: 2022-12-13_10:13:13.615102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:15.552158 run osmo-stp_10.42.42.5(pid=7617): stderr: | 20221213101313807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101313807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101313808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101313808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101313808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101313809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101313809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:15.714736 run patchelf(pid=7620): Terminating (SIGINT) 10:13:15.910675 run patchelf(pid=7620): Terminated: ok {rc=0} 10:13:16.052620 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7617): Process ended prematurely: osmo-stp_10.42.42.5(pid=7617) [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7617)] [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 10:13:16.062920 tst iperf3.py:8: Test FAILED (7.8 sec) 10:13:16.091372 run osmo-hlr_10.42.42.2(pid=7614): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7614)] 10:13:16.141729 run osmo-hlr_10.42.42.2(pid=7614): stdout: | (launched: 2022-12-13_10:13:12.567611) 10:13:16.194354 run osmo-hlr_10.42.42.2(pid=7614): stderr: | 20221213101312764 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101312764 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101312765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101312765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101312765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101312765 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101312781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101312791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101312792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101312792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:16.247283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7609): Terminating (SIGTERM) 10:13:16.290791 run iperf3-srv_10.42.42.10(pid=7610): Terminating (SIGTERM) 10:13:16.332419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7613): Terminating (SIGTERM) 10:13:16.376047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7616): Terminating (SIGTERM) 10:13:16.420409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7619): Terminating (SIGTERM) 10:13:16.464550 --- ParallelTerminationStrategy: PID 7609 died... 10:13:16.484880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7609): Terminated: ok {rc=0} 10:13:16.532503 --- ParallelTerminationStrategy: PID 7610 died... 10:13:16.553282 run iperf3-srv_10.42.42.10(pid=7610): Terminated {rc=256} 10:13:16.599199 --- ParallelTerminationStrategy: PID 7613 died... 10:13:16.619065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7613): Terminated: ok {rc=0} 10:13:16.665890 --- ParallelTerminationStrategy: PID 7616 died... 10:13:16.685741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7616): Terminated: ok {rc=0} 10:13:16.731499 --- ParallelTerminationStrategy: PID 7619 died... 10:13:16.752421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7619): Terminated: ok {rc=0} 10:13:16.839723 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:13:17.988290 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:17.999919 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:13:18.057126 tst iperf3m4.py: using LAC 33235 10:13:18.181100 tst iperf3m4.py: using RAC 85 10:13:18.304850 tst iperf3m4.py: using CellId 33235 10:13:18.429253 tst iperf3m4.py: using BVCI 33236 10:13:18.544300 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:18.555434 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:18.566335 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:18.577120 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:18.587914 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:18.598708 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:18.609705 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:18.620329 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:18.631960 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:13:18.750263 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:13:18.876152 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:13:18.999498 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:13:19.123409 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:13:19.352442 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:19.692596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7621): Launched 10:13:19.987284 run iperf3-srv_10.42.42.10(pid=7622): Launched 10:13:20.115451 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:13:20.342604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:20.681564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7623): Launched 10:13:20.975856 run iperf3-srv_10.42.42.10(pid=7624): Launched 10:13:21.103693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:13:21.330914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:21.669649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7625): Launched 10:13:21.965141 run iperf3-srv_10.42.42.10(pid=7626): Launched 10:13:22.093575 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:13:22.321164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:22.660064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7627): Launched 10:13:22.954115 run iperf3-srv_10.42.42.10(pid=7628): Launched 10:13:23.082109 tst iperf3m4.py:8: start network... 10:13:23.309658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:23.831773 run create_hlr_db(pid=7629): Launched 10:13:23.960837 bus /gobi_6: Setting Powered False 10:13:25.026586 run create_hlr_db(pid=7629): Terminated: ok {rc=0} 10:13:25.476173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7641): Launched 10:13:25.794012 run osmo-hlr_10.42.42.2(pid=7642): Launched 10:13:25.912414 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:26.453303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7644): Launched 10:13:26.768859 run osmo-stp_10.42.42.5(pid=7645): Launched 10:13:26.888861 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:27.428263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7647): Launched 10:13:27.549832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:27.815717 run patchelf(pid=7648): Launched 10:13:27.991121 run osmo-stp_10.42.42.5(pid=7645): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7645)] 10:13:28.123993 run osmo-stp_10.42.42.5(pid=7645): stdout: | (launched: 2022-12-13_10:13:26.709435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:28.257427 run osmo-stp_10.42.42.5(pid=7645): stderr: | 20221213101326883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101326883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101326883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101326884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101326884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101326884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101326884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:28.390854 run osmo-stp_10.42.42.5(pid=7645): stdout: | (launched: 2022-12-13_10:13:26.709435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:28.518873 run osmo-stp_10.42.42.5(pid=7645): stderr: | 20221213101326883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101326883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101326883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101326884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101326884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101326884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101326884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:28.670317 run patchelf(pid=7648): Terminating (SIGINT) 10:13:28.845561 run patchelf(pid=7648): Terminated: ok {rc=0} 10:13:28.971862 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7645): Process ended prematurely: osmo-stp_10.42.42.5(pid=7645) [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7645)] [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:13:28.981407 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:13:29.008812 run osmo-hlr_10.42.42.2(pid=7642): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7642)] 10:13:29.057247 run osmo-hlr_10.42.42.2(pid=7642): stdout: | (launched: 2022-12-13_10:13:25.734508) 10:13:29.107253 run osmo-hlr_10.42.42.2(pid=7642): stderr: | 20221213101325912 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101325912 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101325912 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101325912 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101325913 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101325913 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101325925 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101325934 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101325934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101325934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:29.157516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7621): Terminating (SIGTERM) 10:13:29.197575 run iperf3-srv_10.42.42.10(pid=7622): Terminating (SIGTERM) 10:13:29.237681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7623): Terminating (SIGTERM) 10:13:29.277824 run iperf3-srv_10.42.42.10(pid=7624): Terminating (SIGTERM) 10:13:29.317639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7625): Terminating (SIGTERM) 10:13:29.357652 run iperf3-srv_10.42.42.10(pid=7626): Terminating (SIGTERM) 10:13:29.397329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7627): Terminating (SIGTERM) 10:13:29.437198 run iperf3-srv_10.42.42.10(pid=7628): Terminating (SIGTERM) 10:13:29.476907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7641): Terminating (SIGTERM) 10:13:29.517154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7644): Terminating (SIGTERM) 10:13:29.557155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7647): Terminating (SIGTERM) 10:13:29.597443 --- ParallelTerminationStrategy: PID 7621 died... 10:13:29.616729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7621): Terminated: ok {rc=0} 10:13:29.661055 --- ParallelTerminationStrategy: PID 7622 died... 10:13:29.679730 run iperf3-srv_10.42.42.10(pid=7622): Terminated {rc=256} 10:13:29.723719 --- ParallelTerminationStrategy: PID 7623 died... 10:13:29.742441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7623): Terminated: ok {rc=0} 10:13:29.786671 --- ParallelTerminationStrategy: PID 7624 died... 10:13:29.805451 run iperf3-srv_10.42.42.10(pid=7624): Terminated {rc=256} 10:13:29.849542 --- ParallelTerminationStrategy: PID 7625 died... 10:13:29.868250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7625): Terminated: ok {rc=0} 10:13:29.912303 --- ParallelTerminationStrategy: PID 7626 died... 10:13:29.930880 run iperf3-srv_10.42.42.10(pid=7626): Terminated {rc=256} 10:13:29.974586 --- ParallelTerminationStrategy: PID 7627 died... 10:13:29.993396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7627): Terminated: ok {rc=0} 10:13:30.037296 --- ParallelTerminationStrategy: PID 7628 died... 10:13:30.055911 run iperf3-srv_10.42.42.10(pid=7628): Terminated {rc=256} 10:13:30.100522 --- ParallelTerminationStrategy: PID 7641 died... 10:13:30.119374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7641): Terminated: ok {rc=0} 10:13:30.163718 --- ParallelTerminationStrategy: PID 7644 died... 10:13:30.182505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7644): Terminated: ok {rc=0} 10:13:30.226834 --- ParallelTerminationStrategy: PID 7647 died... 10:13:30.245713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7647): Terminated: ok {rc=0} 10:13:30.332435 bus /gobi_4: Setting Powered False 10:13:31.434982 bus /gobi_4: Setting Powered False 10:13:32.551912 bus /gobi_1: Setting Powered False 10:13:33.650630 bus /gobi_1: Setting Powered False 10:13:34.766814 bus /gobi_0: Setting Powered False 10:13:35.866235 bus /gobi_0: Setting Powered False 10:13:36.982813 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:13:38.087597 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:38.100293 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:13:38.159263 tst ping.py: using LAC 33236 10:13:38.289460 tst ping.py: using RAC 86 10:13:38.411761 tst ping.py: using CellId 33236 10:13:38.534778 tst ping.py: using BVCI 33237 10:13:38.649085 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:38.660114 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:38.670898 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:38.681642 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:38.692193 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:38.703584 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:38.714497 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:38.725253 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:13:38.845699 tst ping.py:19: start network... 10:13:39.051208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:39.529755 run create_hlr_db(pid=7649): Launched 10:13:39.655441 bus /gobi_6: Setting Powered False 10:13:40.716360 run create_hlr_db(pid=7649): Terminated: ok {rc=0} 10:13:41.171181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7651): Launched 10:13:41.504850 run osmo-hlr_10.42.42.2(pid=7652): Launched 10:13:41.632506 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:42.215080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7654): Launched 10:13:42.549019 run osmo-stp_10.42.42.5(pid=7655): Launched 10:13:42.676510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:43.247136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7657): Launched 10:13:43.373598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:43.654712 run patchelf(pid=7658): Launched 10:13:43.837701 run osmo-stp_10.42.42.5(pid=7655): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7655)] 10:13:43.977466 run osmo-stp_10.42.42.5(pid=7655): stdout: | (launched: 2022-12-13_10:13:42.486755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:44.119000 run osmo-stp_10.42.42.5(pid=7655): stderr: | 20221213101342678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101342678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101342679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101342679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101342680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101342680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101342680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:44.260459 run osmo-stp_10.42.42.5(pid=7655): stdout: | (launched: 2022-12-13_10:13:42.486755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:44.396426 run osmo-stp_10.42.42.5(pid=7655): stderr: | 20221213101342678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101342678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101342679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101342679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101342680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101342680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101342680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:44.556747 run patchelf(pid=7658): Terminating (SIGINT) 10:13:44.741465 run patchelf(pid=7658): Terminated: ok {rc=0} 10:13:44.875177 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7655): Process ended prematurely: osmo-stp_10.42.42.5(pid=7655) [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7655)] [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 10:13:44.885475 tst ping.py:22: Test FAILED (6.8 sec) 10:13:44.914035 run osmo-hlr_10.42.42.2(pid=7652): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7652)] 10:13:44.965771 run osmo-hlr_10.42.42.2(pid=7652): stdout: | (launched: 2022-12-13_10:13:41.442846) 10:13:45.018841 run osmo-hlr_10.42.42.2(pid=7652): stderr: | 20221213101341638 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101341638 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101341638 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101341638 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101341638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101341638 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101341651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101341660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101341660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101341660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:45.071665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7651): Terminating (SIGTERM) 10:13:45.114800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7654): Terminating (SIGTERM) 10:13:45.157770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7657): Terminating (SIGTERM) 10:13:45.200749 --- ParallelTerminationStrategy: PID 7651 died... 10:13:45.221702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7651): Terminated: ok {rc=0} 10:13:45.268882 --- ParallelTerminationStrategy: PID 7654 died... 10:13:45.289363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7654): Terminated: ok {rc=0} 10:13:45.336213 --- ParallelTerminationStrategy: PID 7657 died... 10:13:45.356377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7657): Terminated: ok {rc=0} 10:13:45.445550 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:13:46.531867 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:46.544646 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:13:46.609912 tst ping_idle_ping.py: using LAC 33237 10:13:46.742251 tst ping_idle_ping.py: using RAC 87 10:13:46.893013 tst ping_idle_ping.py: using CellId 33237 10:13:47.023544 tst ping_idle_ping.py: using BVCI 33238 10:13:47.146575 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:47.158775 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:47.170994 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:47.182845 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:47.195085 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:47.207016 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:47.219253 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:47.231254 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:13:47.356470 tst ping_idle_ping.py:24: start network... 10:13:47.580546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:48.098115 run create_hlr_db(pid=7659): Launched 10:13:48.226516 bus /gobi_6: Setting Powered False 10:13:49.291856 run create_hlr_db(pid=7659): Terminated: ok {rc=0} 10:13:49.737820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7661): Launched 10:13:50.051837 run osmo-hlr_10.42.42.2(pid=7662): Launched 10:13:50.171422 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:50.719068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7664): Launched 10:13:51.031142 run osmo-stp_10.42.42.5(pid=7665): Launched 10:13:51.150917 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:51.686096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7667): Launched 10:13:51.805766 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:52.069308 run patchelf(pid=7668): Launched 10:13:52.241090 run osmo-stp_10.42.42.5(pid=7665): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7665)] 10:13:52.372275 run osmo-stp_10.42.42.5(pid=7665): stdout: | (launched: 2022-12-13_10:13:50.972805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:52.504740 run osmo-stp_10.42.42.5(pid=7665): stderr: | 20221213101351143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101351143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101351143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101351144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101351144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101351144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101351144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:52.637298 run osmo-stp_10.42.42.5(pid=7665): stdout: | (launched: 2022-12-13_10:13:50.972805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:52.764339 run osmo-stp_10.42.42.5(pid=7665): stderr: | 20221213101351143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101351143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101351143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101351144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101351144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101351144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101351144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:52.914719 run patchelf(pid=7668): Terminating (SIGINT) 10:13:53.088468 run patchelf(pid=7668): Terminated: ok {rc=0} 10:13:53.214168 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7665): Process ended prematurely: osmo-stp_10.42.42.5(pid=7665) [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7665)] [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:13:53.223119 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:13:53.249942 run osmo-hlr_10.42.42.2(pid=7662): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7662)] 10:13:53.298111 run osmo-hlr_10.42.42.2(pid=7662): stdout: | (launched: 2022-12-13_10:13:49.992579) 10:13:53.348135 run osmo-hlr_10.42.42.2(pid=7662): stderr: | 20221213101350172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101350172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101350172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101350173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101350173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101350173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101350185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101350196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101350196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101350196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:53.398656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7661): Terminating (SIGTERM) 10:13:53.438903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7664): Terminating (SIGTERM) 10:13:53.479129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7667): Terminating (SIGTERM) 10:13:53.519753 --- ParallelTerminationStrategy: PID 7661 died... 10:13:53.538618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7661): Terminated: ok {rc=0} 10:13:53.583251 --- ParallelTerminationStrategy: PID 7664 died... 10:13:53.602195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7664): Terminated: ok {rc=0} 10:13:53.646523 --- ParallelTerminationStrategy: PID 7667 died... 10:13:53.665453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7667): Terminated: ok {rc=0} 10:13:53.752407 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:13:55.040383 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:13:55.046991 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:13:55.068157 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:13:55.107140 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:13:55.194000 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:13:55.214948 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:13:55.253230 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:13:55.845914 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:13:55.895911 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:55.906781 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:13:55.964225 tst cs_paging_gprs_active.py: using LAC 33238 10:13:56.087952 tst cs_paging_gprs_active.py: using RAC 88 10:13:56.215737 tst cs_paging_gprs_active.py: using CellId 33238 10:13:56.338725 tst cs_paging_gprs_active.py: using BVCI 33239 10:13:56.454246 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:56.465137 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:56.475737 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:56.486408 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:56.496918 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:56.508031 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:56.519235 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:56.529813 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:56.540511 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:13:56.664608 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:13:56.785542 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:13:56.997055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:57.313731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7672): Launched 10:13:57.587238 run iperf3-srv_10.42.42.10(pid=7673): Launched 10:13:57.706309 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:13:57.916481 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:58.231994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7674): Launched 10:13:58.509079 run iperf3-srv_10.42.42.10(pid=7675): Launched 10:13:58.628498 tst cs_paging_gprs_active.py:38: start network... 10:13:58.838072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:59.325365 run create_hlr_db(pid=7676): Launched 10:13:59.454123 bus /gobi_6: Setting Powered False 10:14:00.515845 run create_hlr_db(pid=7676): Terminated: ok {rc=0} 10:14:00.979439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7678): Launched 10:14:01.313629 run osmo-hlr_10.42.42.2(pid=7679): Launched 10:14:01.594098 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:02.274758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7681): Launched 10:14:02.615545 run osmo-stp_10.42.42.5(pid=7682): Launched 10:14:02.745804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:03.327621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7684): Launched 10:14:03.457860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:03.744096 run patchelf(pid=7685): Launched 10:14:03.930976 run osmo-stp_10.42.42.5(pid=7682): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7682)] 10:14:04.072865 run osmo-stp_10.42.42.5(pid=7682): stdout: | (launched: 2022-12-13_10:14:02.552364) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:04.216829 run osmo-stp_10.42.42.5(pid=7682): stderr: | 20221213101402742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101402742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101402743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101402743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101402744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101402744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101402744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:04.360439 run osmo-stp_10.42.42.5(pid=7682): stdout: | (launched: 2022-12-13_10:14:02.552364) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:04.498146 run osmo-stp_10.42.42.5(pid=7682): stderr: | 20221213101402742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101402742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101402743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101402743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101402744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101402744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101402744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:04.660713 run patchelf(pid=7685): Terminating (SIGINT) 10:14:04.849396 run patchelf(pid=7685): Terminated: ok {rc=0} 10:14:04.985311 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7682): Process ended prematurely: osmo-stp_10.42.42.5(pid=7682) [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7682)] [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:14:04.995555 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 10:14:05.024267 run osmo-hlr_10.42.42.2(pid=7679): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7679)] 10:14:05.075300 run osmo-hlr_10.42.42.2(pid=7679): stdout: | (launched: 2022-12-13_10:14:01.252340) 10:14:05.128381 run osmo-hlr_10.42.42.2(pid=7679): stderr: | 20221213101401522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101401522 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101401522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101401522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101401522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101401522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101401534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101401547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101401547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101401547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:05.181909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7672): Terminating (SIGTERM) 10:14:05.223966 run iperf3-srv_10.42.42.10(pid=7673): Terminating (SIGTERM) 10:14:05.266340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7674): Terminating (SIGTERM) 10:14:05.309362 run iperf3-srv_10.42.42.10(pid=7675): Terminating (SIGTERM) 10:14:05.351626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7678): Terminating (SIGTERM) 10:14:05.394462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7681): Terminating (SIGTERM) 10:14:05.436830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7684): Terminating (SIGTERM) 10:14:05.479408 --- ParallelTerminationStrategy: PID 7672 died... 10:14:05.500064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7672): Terminated: ok {rc=0} 10:14:05.546945 --- ParallelTerminationStrategy: PID 7673 died... 10:14:05.567411 run iperf3-srv_10.42.42.10(pid=7673): Terminated {rc=256} 10:14:05.614083 --- ParallelTerminationStrategy: PID 7674 died... 10:14:05.634094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7674): Terminated: ok {rc=0} 10:14:05.680850 --- ParallelTerminationStrategy: PID 7675 died... 10:14:05.701229 run iperf3-srv_10.42.42.10(pid=7675): Terminated {rc=256} 10:14:05.747931 --- ParallelTerminationStrategy: PID 7678 died... 10:14:05.768365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7678): Terminated: ok {rc=0} 10:14:05.815132 --- ParallelTerminationStrategy: PID 7681 died... 10:14:05.835072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7681): Terminated: ok {rc=0} 10:14:05.881827 --- ParallelTerminationStrategy: PID 7684 died... 10:14:05.901867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7684): Terminated: ok {rc=0} 10:14:05.990531 bus /gobi_0: Setting Powered False 10:14:07.089740 bus /gobi_0: Setting Powered False 10:14:08.206604 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:14:09.360711 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:09.372725 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:14:09.433365 tst iperf3.py: using LAC 33239 10:14:09.564314 tst iperf3.py: using RAC 89 10:14:09.695032 tst iperf3.py: using CellId 33239 10:14:09.827942 tst iperf3.py: using BVCI 33240 10:14:09.950543 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:09.961977 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:09.973218 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:09.984321 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:09.995759 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:10.007248 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:10.018877 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:10.030429 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:10.042095 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:14:10.161224 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:14:10.373510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:10.691959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7686): Launched 10:14:10.969788 run iperf3-srv_10.42.42.10(pid=7687): Launched 10:14:11.087084 tst iperf3.py:8: start network... 10:14:11.296890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:11.783153 run create_hlr_db(pid=7688): Launched 10:14:11.910925 bus /gobi_6: Setting Powered False 10:14:12.973907 run create_hlr_db(pid=7688): Terminated: ok {rc=0} 10:14:13.433542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7691): Launched 10:14:13.772718 run osmo-hlr_10.42.42.2(pid=7692): Launched 10:14:13.902281 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:14.484427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7694): Launched 10:14:14.822497 run osmo-stp_10.42.42.5(pid=7695): Launched 10:14:14.950168 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:15.531649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7697): Launched 10:14:15.660744 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:15.954123 run patchelf(pid=7698): Launched 10:14:16.158759 run osmo-stp_10.42.42.5(pid=7695): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7695)] 10:14:16.298329 run osmo-stp_10.42.42.5(pid=7695): stdout: | (launched: 2022-12-13_10:14:14.759329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:16.437728 run osmo-stp_10.42.42.5(pid=7695): stderr: | 20221213101414950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101414950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101414950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101414951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101414951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101414951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101414951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:16.577152 run osmo-stp_10.42.42.5(pid=7695): stdout: | (launched: 2022-12-13_10:14:14.759329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:16.709542 run osmo-stp_10.42.42.5(pid=7695): stderr: | 20221213101414950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101414950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101414950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101414951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101414951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101414951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101414951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:16.867175 run patchelf(pid=7698): Terminating (SIGINT) 10:14:17.048755 run patchelf(pid=7698): Terminated: ok {rc=0} 10:14:17.180904 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7695): Process ended prematurely: osmo-stp_10.42.42.5(pid=7695) [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7695)] [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 10:14:17.191207 tst iperf3.py:8: Test FAILED (7.9 sec) 10:14:17.219593 run osmo-hlr_10.42.42.2(pid=7692): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7692)] 10:14:17.268326 run osmo-hlr_10.42.42.2(pid=7692): stdout: | (launched: 2022-12-13_10:14:13.710005) 10:14:17.318814 run osmo-hlr_10.42.42.2(pid=7692): stderr: | 20221213101413906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101413907 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101413907 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101413907 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101413907 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101413907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101413918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101413926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101413926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101413926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:17.369801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7686): Terminating (SIGTERM) 10:14:17.410428 run iperf3-srv_10.42.42.10(pid=7687): Terminating (SIGTERM) 10:14:17.450859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7691): Terminating (SIGTERM) 10:14:17.491526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7694): Terminating (SIGTERM) 10:14:17.532190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7697): Terminating (SIGTERM) 10:14:17.573086 --- ParallelTerminationStrategy: PID 7686 died... 10:14:17.592613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7686): Terminated: ok {rc=0} 10:14:17.637919 --- ParallelTerminationStrategy: PID 7687 died... 10:14:17.656852 run iperf3-srv_10.42.42.10(pid=7687): Terminated {rc=256} 10:14:17.701601 --- ParallelTerminationStrategy: PID 7691 died... 10:14:17.720648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7691): Terminated: ok {rc=0} 10:14:17.765449 --- ParallelTerminationStrategy: PID 7694 died... 10:14:17.784538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7694): Terminated: ok {rc=0} 10:14:17.829443 --- ParallelTerminationStrategy: PID 7697 died... 10:14:17.848454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7697): Terminated: ok {rc=0} 10:14:17.936372 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:14:19.087880 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:19.099491 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:14:19.157726 tst iperf3m4.py: using LAC 33240 10:14:19.281437 tst iperf3m4.py: using RAC 90 10:14:19.413634 tst iperf3m4.py: using CellId 33240 10:14:19.537388 tst iperf3m4.py: using BVCI 33241 10:14:19.651573 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:19.662692 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:19.674013 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:19.684894 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:19.695722 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:19.706547 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:19.717374 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:19.727936 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:19.738878 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:14:19.856315 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:14:19.981859 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:14:20.101748 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:14:20.223465 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:14:20.434340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:20.752646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7699): Launched 10:14:21.028065 run iperf3-srv_10.42.42.10(pid=7700): Launched 10:14:21.146922 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:14:21.356253 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:21.671054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7701): Launched 10:14:21.946480 run iperf3-srv_10.42.42.10(pid=7702): Launched 10:14:22.063359 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:14:22.274243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:22.589941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7703): Launched 10:14:22.864937 run iperf3-srv_10.42.42.10(pid=7704): Launched 10:14:22.981855 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:14:23.191000 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:23.506205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7705): Launched 10:14:23.781938 run iperf3-srv_10.42.42.10(pid=7706): Launched 10:14:23.900461 tst iperf3m4.py:8: start network... 10:14:24.108326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:24.593562 run create_hlr_db(pid=7707): Launched 10:14:24.721662 bus /gobi_6: Setting Powered False 10:14:25.783611 run create_hlr_db(pid=7707): Terminated: ok {rc=0} 10:14:26.244090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7709): Launched 10:14:26.583911 run osmo-hlr_10.42.42.2(pid=7710): Launched 10:14:26.711738 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:27.301882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7712): Launched 10:14:27.641449 run osmo-stp_10.42.42.5(pid=7713): Launched 10:14:27.769934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:28.351078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7715): Launched 10:14:28.481267 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:28.768206 run patchelf(pid=7716): Launched 10:14:28.956071 run osmo-stp_10.42.42.5(pid=7713): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7713)] 10:14:29.098272 run osmo-stp_10.42.42.5(pid=7713): stdout: | (launched: 2022-12-13_10:14:27.578075) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:29.242311 run osmo-stp_10.42.42.5(pid=7713): stderr: | 20221213101427770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101427770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101427770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101427771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101427771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101427771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101427771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:29.386403 run osmo-stp_10.42.42.5(pid=7713): stdout: | (launched: 2022-12-13_10:14:27.578075) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:29.524572 run osmo-stp_10.42.42.5(pid=7713): stderr: | 20221213101427770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101427770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101427770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101427771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101427771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101427771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101427771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:29.688397 run patchelf(pid=7716): Terminating (SIGINT) 10:14:29.877371 run patchelf(pid=7716): Terminated: ok {rc=0} 10:14:30.013760 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7713): Process ended prematurely: osmo-stp_10.42.42.5(pid=7713) [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7713)] [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:14:30.024076 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:14:30.053349 run osmo-hlr_10.42.42.2(pid=7710): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7710)] 10:14:30.105189 run osmo-hlr_10.42.42.2(pid=7710): stdout: | (launched: 2022-12-13_10:14:26.520061) 10:14:30.158718 run osmo-hlr_10.42.42.2(pid=7710): stderr: | 20221213101426718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101426718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101426718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101426718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101426718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101426718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101426731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101426741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101426741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101426742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:30.212315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7699): Terminating (SIGTERM) 10:14:30.254819 run iperf3-srv_10.42.42.10(pid=7700): Terminating (SIGTERM) 10:14:30.297674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7701): Terminating (SIGTERM) 10:14:30.340651 run iperf3-srv_10.42.42.10(pid=7702): Terminating (SIGTERM) 10:14:30.383800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7703): Terminating (SIGTERM) 10:14:30.426647 run iperf3-srv_10.42.42.10(pid=7704): Terminating (SIGTERM) 10:14:30.469211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7705): Terminating (SIGTERM) 10:14:30.511895 run iperf3-srv_10.42.42.10(pid=7706): Terminating (SIGTERM) 10:14:30.554504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7709): Terminating (SIGTERM) 10:14:30.597321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7712): Terminating (SIGTERM) 10:14:30.639930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7715): Terminating (SIGTERM) 10:14:30.682746 --- ParallelTerminationStrategy: PID 7699 died... 10:14:30.703476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7699): Terminated: ok {rc=0} 10:14:30.750739 --- ParallelTerminationStrategy: PID 7700 died... 10:14:30.770775 run iperf3-srv_10.42.42.10(pid=7700): Terminated {rc=256} 10:14:30.817614 --- ParallelTerminationStrategy: PID 7701 died... 10:14:30.837805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7701): Terminated: ok {rc=0} 10:14:30.900744 --- ParallelTerminationStrategy: PID 7702 died... 10:14:30.931479 run iperf3-srv_10.42.42.10(pid=7702): Terminated {rc=256} 10:14:30.980041 --- ParallelTerminationStrategy: PID 7703 died... 10:14:31.001220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7703): Terminated: ok {rc=0} 10:14:31.060877 --- ParallelTerminationStrategy: PID 7704 died... 10:14:31.082746 run iperf3-srv_10.42.42.10(pid=7704): Terminated {rc=256} 10:14:31.129942 --- ParallelTerminationStrategy: PID 7705 died... 10:14:31.151220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7705): Terminated: ok {rc=0} 10:14:31.200232 --- ParallelTerminationStrategy: PID 7706 died... 10:14:31.221452 run iperf3-srv_10.42.42.10(pid=7706): Terminated {rc=256} 10:14:31.268754 --- ParallelTerminationStrategy: PID 7709 died... 10:14:31.290303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7709): Terminated: ok {rc=0} 10:14:31.338540 --- ParallelTerminationStrategy: PID 7712 died... 10:14:31.359942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7712): Terminated: ok {rc=0} 10:14:31.408233 --- ParallelTerminationStrategy: PID 7715 died... 10:14:31.429467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7715): Terminated: ok {rc=0} 10:14:31.521120 bus /gobi_4: Setting Powered False 10:14:32.622364 bus /gobi_4: Setting Powered False 10:14:33.740258 bus /gobi_1: Setting Powered False 10:14:34.841063 bus /gobi_1: Setting Powered False 10:14:35.957476 bus /gobi_0: Setting Powered False 10:14:37.057389 bus /gobi_0: Setting Powered False 10:14:38.175632 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:14:39.280426 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:39.292184 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:14:39.349362 tst ping.py: using LAC 33241 10:14:39.480842 tst ping.py: using RAC 91 10:14:39.611836 tst ping.py: using CellId 33241 10:14:39.740425 tst ping.py: using BVCI 33242 10:14:39.862494 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:39.874190 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:39.885554 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:39.896798 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:39.908726 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:39.920673 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:39.932852 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:39.944865 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:14:40.065508 tst ping.py:19: start network... 10:14:40.271239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:40.750642 run create_hlr_db(pid=7717): Launched 10:14:40.878404 bus /gobi_6: Setting Powered False 10:14:41.939464 run create_hlr_db(pid=7717): Terminated: ok {rc=0} 10:14:42.394043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7719): Launched 10:14:42.726818 run osmo-hlr_10.42.42.2(pid=7720): Launched 10:14:42.852776 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:43.431374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7722): Launched 10:14:43.763754 run osmo-stp_10.42.42.5(pid=7723): Launched 10:14:43.890505 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:44.461798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7725): Launched 10:14:44.588891 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:44.870295 run patchelf(pid=7726): Launched 10:14:45.055383 run osmo-stp_10.42.42.5(pid=7723): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7723)] 10:14:45.195669 run osmo-stp_10.42.42.5(pid=7723): stdout: | (launched: 2022-12-13_10:14:43.701498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:45.336624 run osmo-stp_10.42.42.5(pid=7723): stderr: | 20221213101443892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101443892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101443892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101443893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101443893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101443893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101443894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:45.477558 run osmo-stp_10.42.42.5(pid=7723): stdout: | (launched: 2022-12-13_10:14:43.701498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:45.612873 run osmo-stp_10.42.42.5(pid=7723): stderr: | 20221213101443892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101443892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101443892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101443893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101443893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101443893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101443894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:45.773228 run patchelf(pid=7726): Terminating (SIGINT) 10:14:45.973263 run patchelf(pid=7726): Terminated: ok {rc=0} 10:14:46.110354 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7723): Process ended prematurely: osmo-stp_10.42.42.5(pid=7723) [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7723)] [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 10:14:46.121187 tst ping.py:22: Test FAILED (6.8 sec) 10:14:46.151273 run osmo-hlr_10.42.42.2(pid=7720): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7720)] 10:14:46.206505 run osmo-hlr_10.42.42.2(pid=7720): stdout: | (launched: 2022-12-13_10:14:42.664375) 10:14:46.262234 run osmo-hlr_10.42.42.2(pid=7720): stderr: | 20221213101442860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101442861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101442861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101442861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101442861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101442861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101442873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101442883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101442883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101442883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:46.320425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7719): Terminating (SIGTERM) 10:14:46.364802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7722): Terminating (SIGTERM) 10:14:46.411921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7725): Terminating (SIGTERM) 10:14:46.459133 --- ParallelTerminationStrategy: PID 7719 died... 10:14:46.481798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7719): Terminated: ok {rc=0} 10:14:46.532592 --- ParallelTerminationStrategy: PID 7722 died... 10:14:46.554286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7722): Terminated: ok {rc=0} 10:14:46.604053 --- ParallelTerminationStrategy: PID 7725 died... 10:14:46.625760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7725): Terminated: ok {rc=0} 10:14:46.721226 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:14:47.810938 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:47.823139 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:14:47.885456 tst ping_idle_ping.py: using LAC 33242 10:14:48.014391 tst ping_idle_ping.py: using RAC 92 10:14:48.144481 tst ping_idle_ping.py: using CellId 33242 10:14:48.277392 tst ping_idle_ping.py: using BVCI 33243 10:14:48.398377 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:48.410089 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:48.421300 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:48.432624 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:48.444343 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:48.456042 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:48.467762 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:48.479261 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:14:48.600799 tst ping_idle_ping.py:24: start network... 10:14:48.826182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:49.346095 run create_hlr_db(pid=7727): Launched 10:14:49.474519 bus /gobi_6: Setting Powered False 10:14:50.539004 run create_hlr_db(pid=7727): Terminated: ok {rc=0} 10:14:51.003389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7729): Launched 10:14:51.337982 run osmo-hlr_10.42.42.2(pid=7730): Launched 10:14:51.468117 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:52.044140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7732): Launched 10:14:52.380351 run osmo-stp_10.42.42.5(pid=7733): Launched 10:14:52.508546 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:53.082969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7735): Launched 10:14:53.211596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:53.493450 run patchelf(pid=7736): Launched 10:14:53.678365 run osmo-stp_10.42.42.5(pid=7733): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7733)] 10:14:53.818166 run osmo-stp_10.42.42.5(pid=7733): stdout: | (launched: 2022-12-13_10:14:52.317938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:53.960003 run osmo-stp_10.42.42.5(pid=7733): stderr: | 20221213101452507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101452507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101452508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101452508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101452509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101452509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101452509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:54.101353 run osmo-stp_10.42.42.5(pid=7733): stdout: | (launched: 2022-12-13_10:14:52.317938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:54.237348 run osmo-stp_10.42.42.5(pid=7733): stderr: | 20221213101452507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101452507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101452508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101452508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101452509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101452509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101452509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:54.398141 run patchelf(pid=7736): Terminating (SIGINT) 10:14:54.584482 run patchelf(pid=7736): Terminated: ok {rc=0} 10:14:54.718462 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7733): Process ended prematurely: osmo-stp_10.42.42.5(pid=7733) [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7733)] [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:14:54.728181 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 10:14:54.757570 run osmo-hlr_10.42.42.2(pid=7730): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7730)] 10:14:54.808908 run osmo-hlr_10.42.42.2(pid=7730): stdout: | (launched: 2022-12-13_10:14:51.275216) 10:14:54.861841 run osmo-hlr_10.42.42.2(pid=7730): stderr: | 20221213101451474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101451474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101451474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101451474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101451474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101451474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101451487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101451496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101451496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101451496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:54.914978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7729): Terminating (SIGTERM) 10:14:54.957446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7732): Terminating (SIGTERM) 10:14:55.000627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7735): Terminating (SIGTERM) 10:14:55.043788 --- ParallelTerminationStrategy: PID 7729 died... 10:14:55.064851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7729): Terminated: ok {rc=0} 10:14:55.112417 --- ParallelTerminationStrategy: PID 7732 died... 10:14:55.133026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7732): Terminated: ok {rc=0} 10:14:55.180356 --- ParallelTerminationStrategy: PID 7735 died... 10:14:55.201009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7735): Terminated: ok {rc=0} 10:14:55.290412 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:14:56.580529 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:14:56.589508 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:14:56.610982 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:14:56.647287 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:14:56.700158 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:14:56.722212 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:14:56.758677 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:14:57.313795 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:14:57.319243 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:14:57.330754 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:14:57.385585 tst switch_tch_pdch.py: using LAC 33243 10:14:57.507976 tst switch_tch_pdch.py: using RAC 93 10:14:57.628712 tst switch_tch_pdch.py: using CellId 33243 10:14:57.749084 tst switch_tch_pdch.py: using BVCI 33244 10:14:57.860359 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:14:57.871700 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:14:57.882736 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:14:57.893707 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:14:57.904556 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:14:57.915536 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:14:57.926660 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:14:57.937605 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:14:58.053659 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:14:58.177279 tst switch_tch_pdch.py:51: start network... 10:14:58.382001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:58.858323 run create_hlr_db(pid=7740): Launched 10:14:58.985557 bus /gobi_6: Setting Powered False 10:15:00.046325 run create_hlr_db(pid=7740): Terminated: ok {rc=0} 10:15:00.499881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7742): Launched 10:15:00.831642 run osmo-hlr_10.42.42.2(pid=7743): Launched 10:15:01.034124 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:01.769982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7748): Launched 10:15:02.097488 run osmo-stp_10.42.42.5(pid=7749): Launched 10:15:02.336759 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:02.883524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7751): Launched 10:15:03.002126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:03.263345 run patchelf(pid=7752): Launched 10:15:03.435032 run osmo-stp_10.42.42.5(pid=7749): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7749)] 10:15:03.564609 run osmo-stp_10.42.42.5(pid=7749): stdout: | (launched: 2022-12-13_10:15:02.037652) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:03.695634 run osmo-stp_10.42.42.5(pid=7749): stderr: | 20221213101502373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101502373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101502373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101502374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101502374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101502374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101502374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:03.826873 run osmo-stp_10.42.42.5(pid=7749): stdout: | (launched: 2022-12-13_10:15:02.037652) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:03.952428 run osmo-stp_10.42.42.5(pid=7749): stderr: | 20221213101502373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101502373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101502373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101502374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101502374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101502374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101502374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:04.101156 run patchelf(pid=7752): Terminating (SIGINT) 10:15:04.275178 run patchelf(pid=7752): Terminated: ok {rc=0} 10:15:04.400446 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7749): Process ended prematurely: osmo-stp_10.42.42.5(pid=7749) [trial-2388↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7749)] [trial-2388↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:15:04.409447 tst switch_tch_pdch.py:54: Test FAILED (7.1 sec) 10:15:04.436205 run osmo-hlr_10.42.42.2(pid=7743): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7743)] 10:15:04.484020 run osmo-hlr_10.42.42.2(pid=7743): stdout: | (launched: 2022-12-13_10:15:00.769412) 10:15:04.533656 run osmo-hlr_10.42.42.2(pid=7743): stderr: | 20221213101501084 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101501084 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101501084 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101501084 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101501085 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101501085 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101501102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101501120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101501120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101501120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:04.583603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7742): Terminating (SIGTERM) 10:15:04.623776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7748): Terminating (SIGTERM) 10:15:04.663954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7751): Terminating (SIGTERM) 10:15:04.704551 --- ParallelTerminationStrategy: PID 7742 died... 10:15:04.724076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7742): Terminated: ok {rc=0} 10:15:04.768752 --- ParallelTerminationStrategy: PID 7748 died... 10:15:04.788193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7748): Terminated: ok {rc=0} 10:15:04.833272 --- ParallelTerminationStrategy: PID 7751 died... 10:15:04.852145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7751): Terminated: ok {rc=0} 10:15:04.937038 bus /gobi_0: Setting Powered False 10:15:06.034386 bus /gobi_0: Setting Powered False 10:15:07.149428 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:15:08.390441 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:15:08.397518 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:15:08.418234 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:15:08.452871 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:15:08.506190 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:15:08.527101 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:15:08.561443 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:15:09.118791 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:15:09.124546 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:09.136215 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:15:09.195882 tst switch_tch_pdch.py: using LAC 33244 10:15:09.324925 tst switch_tch_pdch.py: using RAC 94 10:15:09.456791 tst switch_tch_pdch.py: using CellId 33244 10:15:09.610612 tst switch_tch_pdch.py: using BVCI 33245 10:15:09.730074 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:09.741595 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:09.752879 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:09.764149 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:09.775592 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:09.787065 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:09.798779 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:09.810437 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:15:09.929419 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:15:10.052460 tst switch_tch_pdch.py:51: start network... 10:15:10.277912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:10.763183 run create_hlr_db(pid=7756): Launched 10:15:10.890250 bus /gobi_6: Setting Powered False 10:15:11.954924 run create_hlr_db(pid=7756): Terminated: ok {rc=0} 10:15:12.388362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7758): Launched 10:15:12.721864 run osmo-hlr_10.42.42.2(pid=7759): Launched 10:15:12.849144 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:13.393829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7761): Launched 10:15:13.727225 run osmo-stp_10.42.42.5(pid=7762): Launched 10:15:13.853376 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:14.396471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7764): Launched 10:15:14.524434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:14.805247 run patchelf(pid=7765): Launched 10:15:14.989546 run osmo-stp_10.42.42.5(pid=7762): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7762)] 10:15:15.129265 run osmo-stp_10.42.42.5(pid=7762): stdout: | (launched: 2022-12-13_10:15:13.664661) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:15.270719 run osmo-stp_10.42.42.5(pid=7762): stderr: | 20221213101513855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101513855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101513856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101513856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101513857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101513857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101513857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:15.411914 run osmo-stp_10.42.42.5(pid=7762): stdout: | (launched: 2022-12-13_10:15:13.664661) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:15.547023 run osmo-stp_10.42.42.5(pid=7762): stderr: | 20221213101513855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101513855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101513856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101513856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101513857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101513857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101513857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:15.707868 run patchelf(pid=7765): Terminating (SIGINT) 10:15:15.909536 run patchelf(pid=7765): Terminated: ok {rc=0} 10:15:16.038776 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7762): Process ended prematurely: osmo-stp_10.42.42.5(pid=7762) [trial-2388↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7762)] [trial-2388↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:15:16.048910 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 10:15:16.077195 run osmo-hlr_10.42.42.2(pid=7759): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7759)] 10:15:16.127955 run osmo-hlr_10.42.42.2(pid=7759): stdout: | (launched: 2022-12-13_10:15:12.659630) 10:15:16.181332 run osmo-hlr_10.42.42.2(pid=7759): stderr: | 20221213101512857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101512857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101512857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101512857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101512857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101512857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101512867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101512876 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101512877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101512877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:16.233200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7758): Terminating (SIGTERM) 10:15:16.275303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7761): Terminating (SIGTERM) 10:15:16.319307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7764): Terminating (SIGTERM) 10:15:16.365671 --- ParallelTerminationStrategy: PID 7758 died... 10:15:16.387049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7758): Terminated: ok {rc=0} 10:15:16.434727 --- ParallelTerminationStrategy: PID 7761 died... 10:15:16.454443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7761): Terminated: ok {rc=0} 10:15:16.500303 --- ParallelTerminationStrategy: PID 7764 died... 10:15:16.519925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7764): Terminated: ok {rc=0} 10:15:16.615007 bus /gobi_0: Setting Powered False 10:15:17.732045 bus /gobi_0: Setting Powered False 10:15:18.849596 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_sms:oc2g --------------------------------------------------------------------- 10:15:20.089220 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:15:20.093609 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 10:15:20.114742 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 10:15:20.121946 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 10:15:20.177620 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 10:15:20.199354 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 10:15:20.206408 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 10:15:20.743548 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 10:15:20.749099 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 10:15:20.760261 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 10:15:20.796362 tst mo_mt_sms.py: using LAC 33245 10:15:20.920611 tst mo_mt_sms.py: using RAC 95 10:15:21.043748 tst mo_mt_sms.py: using CellId 33245 10:15:21.176396 tst mo_mt_sms.py: using BVCI 33246 10:15:21.297033 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 10:15:21.415283 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 10:15:21.531828 tst mo_mt_sms.py:9: start nitb and bts... 10:15:21.740159 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:15:22.371510 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7769): Launched 10:15:22.707024 run osmo-nitb_10.42.42.2(pid=7770): Launched 10:15:22.890011 run osmo-nitb_10.42.42.2(pid=7770): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7770)] 10:15:23.038439 run osmo-nitb_10.42.42.2(pid=7770): stdout: | (launched: 2022-12-13_10:15:22.644164) 10:15:23.188157 run osmo-nitb_10.42.42.2(pid=7770): stderr: | (launched: 2022-12-13_10:15:22.693990) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:15:23.337842 run osmo-nitb_10.42.42.2(pid=7770): stdout: | (launched: 2022-12-13_10:15:22.644164) 10:15:23.481533 run osmo-nitb_10.42.42.2(pid=7770): stderr: | (launched: 2022-12-13_10:15:22.693990) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7770): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7770) [trial-2388↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7770)] 10:15:23.832382 tst osmo-nitb_10.42.42.2(pid=7770): stdout: | (launched: 2022-12-13_10:15:22.644164) 10:15:23.966525 tst osmo-nitb_10.42.42.2(pid=7770): stderr: | (launched: 2022-12-13_10:15:22.693990) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:15:24.124201 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=7770): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7770) [trial-2388↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7770)] [trial-2388↪nitb_sms:oc2g↪mo_mt_sms.py:11] 10:15:24.133635 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 10:15:24.140870 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7769): Terminating (SIGTERM) 10:15:24.352926 --- ParallelTerminationStrategy: PID 7769 died... 10:15:24.376252 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7769): Terminated: ok {rc=0} 10:15:24.466356 bus /sierra_3: Setting Powered False 10:15:25.569087 bus /sierra_3: Setting Powered False 10:15:26.688232 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 sms:oc2g --------------------------------------------------------------------- 10:15:27.867823 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:15:27.871818 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 10:15:27.892384 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 10:15:27.919234 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 10:15:27.969946 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 10:15:27.991228 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 10:15:28.017768 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 10:15:28.563114 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 sms:oc2g mo_mt_sms.py ---------------------------------------------- 10:15:28.568272 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:15:28.579009 tst sms:oc2g: Using 1 x bts (candidates: 1) 10:15:28.612655 tst mo_mt_sms.py: using LAC 33246 10:15:28.733587 tst mo_mt_sms.py: using RAC 96 10:15:28.852838 tst mo_mt_sms.py: using CellId 33246 10:15:28.982482 tst mo_mt_sms.py: using BVCI 33247 10:15:29.104675 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:15:29.115892 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:15:29.126977 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:15:29.138011 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:15:29.149803 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:15:29.161076 tst sms:oc2g: Using 1 x modem (candidates: 2) 10:15:29.278381 tst sms:oc2g: Using 1 x modem (candidates: 2) 10:15:29.399645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:29.915356 run create_hlr_db(pid=7774): Launched 10:15:30.041604 bus /sierra_2: Setting Powered False 10:15:31.122852 run create_hlr_db(pid=7774): Terminated: ok {rc=0} 10:15:31.590090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7776): Launched 10:15:31.919790 run osmo-hlr_10.42.42.2(pid=7777): Launched 10:15:32.195614 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:32.774903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7779): Launched 10:15:33.110367 run osmo-stp_10.42.42.5(pid=7780): Launched 10:15:33.238874 run osmo-msc_10.42.42.6: Starting osmo-msc 10:15:33.837226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7782): Launched 10:15:34.171829 run osmo-msc_10.42.42.6(pid=7783): Launched 10:15:34.346600 run osmo-stp_10.42.42.5(pid=7780): ERR: Terminated: ERROR {rc=1} [trial-2388↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7780)] 10:15:34.478157 run osmo-stp_10.42.42.5(pid=7780): stdout: | (launched: 2022-12-13_10:15:33.047150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:34.608872 run osmo-stp_10.42.42.5(pid=7780): stderr: | 20221213101533239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101533240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101533240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101533240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101533241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101533241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101533241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:34.737345 run osmo-stp_10.42.42.5(pid=7780): stdout: | (launched: 2022-12-13_10:15:33.047150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:34.859990 run osmo-stp_10.42.42.5(pid=7780): stderr: | 20221213101533239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101533240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101533240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101533240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101533241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101533241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101533241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:35.006818 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7780): Process ended prematurely: osmo-stp_10.42.42.5(pid=7780) [trial-2388↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7780)] [trial-2388↪sms:oc2g↪mo_mt_sms.py:16] 10:15:35.015141 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 10:15:35.041416 run osmo-hlr_10.42.42.2(pid=7777): ERR: Terminated: ERROR {rc=237} [trial-2388↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7777)] 10:15:35.090257 run osmo-hlr_10.42.42.2(pid=7777): stdout: | (launched: 2022-12-13_10:15:31.859626) 10:15:35.140496 run osmo-hlr_10.42.42.2(pid=7777): stderr: | 20221213101532143 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101532143 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101532143 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101532143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101532143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101532144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101532155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101532164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101532164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101532164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:35.210950 run osmo-msc_10.42.42.6(pid=7783): ERR: Terminated: ERROR {rc=2} [trial-2388↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7783)] 10:15:35.259437 run osmo-msc_10.42.42.6(pid=7783): stdout: | (launched: 2022-12-13_10:15:34.108802) 10:15:35.309697 run osmo-msc_10.42.42.6(pid=7783): stderr: | 20221213101534387 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101534387 DLGLOBAL DEBUG validating counter group 0x7f203056ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101534388 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101534388 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101534388 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101534388 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101534390 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101534390 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101534390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101534390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:15:35.360014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7776): Terminating (SIGTERM) 10:15:35.400436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7779): Terminating (SIGTERM) 10:15:35.440866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7782): Terminating (SIGTERM) 10:15:35.481900 --- ParallelTerminationStrategy: PID 7776 died... 10:15:35.500884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7776): Terminated: ok {rc=0} 10:15:35.546032 --- ParallelTerminationStrategy: PID 7779 died... 10:15:35.565065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7779): Terminated: ok {rc=0} 10:15:35.609885 --- ParallelTerminationStrategy: PID 7782 died... 10:15:35.628805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7782): Terminated: ok {rc=0} 10:15:35.713420 bus /sierra_3: Setting Powered False 10:15:36.813472 bus /sierra_3: Setting Powered False 10:15:37.931627 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_ussd:oc2g --------------------------------------------------------------------- 10:15:39.148032 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:15:39.152261 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 10:15:39.173910 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 10:15:39.181272 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 10:15:39.220319 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 10:15:39.241992 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 10:15:39.248888 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 10:15:39.766442 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2388 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 10:15:39.771979 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 10:15:39.783291 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 10:15:39.817640 tst assert_extension.py: using LAC 33247 10:15:39.946595 tst assert_extension.py: using RAC 97 10:15:40.077419 tst assert_extension.py: using CellId 33247 10:15:40.207016 tst assert_extension.py: using BVCI 33248 10:15:40.326385 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 10:15:40.442763 tst assert_extension.py:10: start nitb and bts... 10:15:40.648423 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:15:41.278852 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7788): Launched 10:15:41.588079 run osmo-nitb_10.42.42.2(pid=7789): Launched 10:15:41.759472 run osmo-nitb_10.42.42.2(pid=7789): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7789)] 10:15:41.896663 run osmo-nitb_10.42.42.2(pid=7789): stdout: | (launched: 2022-12-13_10:15:41.529350) 10:15:42.035357 run osmo-nitb_10.42.42.2(pid=7789): stderr: | (launched: 2022-12-13_10:15:41.574906) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:15:42.174535 run osmo-nitb_10.42.42.2(pid=7789): stdout: | (launched: 2022-12-13_10:15:41.529350) 10:15:42.307865 run osmo-nitb_10.42.42.2(pid=7789): stderr: | (launched: 2022-12-13_10:15:41.574906) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7789): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7789) [trial-2388↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7789)] 10:15:42.705279 tst osmo-nitb_10.42.42.2(pid=7789): stdout: | (launched: 2022-12-13_10:15:41.529350) 10:15:42.829123 tst osmo-nitb_10.42.42.2(pid=7789): stderr: | (launched: 2022-12-13_10:15:41.574906) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:15:42.975599 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7789): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7789) [trial-2388↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7789)] [trial-2388↪nitb_ussd:oc2g↪assert_extension.py:12] 10:15:42.984107 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:15:42.990911 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7788): Terminating (SIGTERM) 10:15:43.200254 --- ParallelTerminationStrategy: PID 7788 died... 10:15:43.221415 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7788): Terminated: ok {rc=0} 10:15:43.308434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 ussd:oc2g --------------------------------------------------------------------- 10:15:44.471827 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:15:44.475828 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 10:15:44.496253 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 10:15:44.522808 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 10:15:44.558267 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 10:15:44.578948 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 10:15:44.605397 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 10:15:45.131949 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2388 ussd:oc2g assert_extension.py ---------------------------------------------- 10:15:45.137232 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:15:45.148026 tst ussd:oc2g: Using 1 x bts (candidates: 1) 10:15:45.181266 tst assert_extension.py: using LAC 33248 10:15:45.312890 tst assert_extension.py: using RAC 98 10:15:45.443833 tst assert_extension.py: using CellId 33248 10:15:45.565252 tst assert_extension.py: using BVCI 33249 10:15:45.675843 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:15:45.686373 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:15:45.696843 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:15:45.707167 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:15:45.717590 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:15:45.728445 tst ussd:oc2g: Using 1 x modem (candidates: 1) 10:15:45.848596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:46.362896 run create_hlr_db(pid=7793): Launched 10:15:46.524897 bus /sierra_2: Setting Powered False 10:15:47.588866 run create_hlr_db(pid=7793): Terminated: ok {rc=0} 10:15:48.038489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7795): Launched 10:15:48.348838 run osmo-hlr_10.42.42.2(pid=7796): Launched 10:15:48.467799 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:49.018814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7798): Launched 10:15:49.328887 run osmo-stp_10.42.42.5(pid=7799): Launched 10:15:49.447211 run osmo-msc_10.42.42.6: Starting osmo-msc 10:15:50.000300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7801): Launched 10:15:50.310170 run osmo-msc_10.42.42.6(pid=7802): Launched 10:15:50.484028 run osmo-stp_10.42.42.5(pid=7799): ERR: Terminated: ERROR {rc=1} [trial-2388↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7799)] 10:15:50.613860 run osmo-stp_10.42.42.5(pid=7799): stdout: | (launched: 2022-12-13_10:15:49.270197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:50.743318 run osmo-stp_10.42.42.5(pid=7799): stderr: | 20221213101549444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101549444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101549444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101549444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101549445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101549445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101549445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:50.871129 run osmo-stp_10.42.42.5(pid=7799): stdout: | (launched: 2022-12-13_10:15:49.270197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:50.993401 run osmo-stp_10.42.42.5(pid=7799): stderr: | 20221213101549444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101549444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101549444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101549444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101549445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101549445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101549445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:51.140104 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7799): Process ended prematurely: osmo-stp_10.42.42.5(pid=7799) [trial-2388↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7799)] [trial-2388↪ussd:oc2g↪assert_extension.py:17] 10:15:51.148607 tst assert_extension.py:17: Test FAILED (6.0 sec) 10:15:51.174851 run osmo-hlr_10.42.42.2(pid=7796): ERR: Terminated: ERROR {rc=237} [trial-2388↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7796)] 10:15:51.223584 run osmo-hlr_10.42.42.2(pid=7796): stdout: | (launched: 2022-12-13_10:15:48.289980) 10:15:51.273282 run osmo-hlr_10.42.42.2(pid=7796): stderr: | 20221213101548472 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101548472 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101548472 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101548472 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101548472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101548473 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101548485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101548496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101548496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101548496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:51.342270 run osmo-msc_10.42.42.6(pid=7802): ERR: Terminated: ERROR {rc=2} [trial-2388↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7802)] 10:15:51.389845 run osmo-msc_10.42.42.6(pid=7802): stdout: | (launched: 2022-12-13_10:15:50.251356) 10:15:51.439085 run osmo-msc_10.42.42.6(pid=7802): stderr: | 20221213101550525 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101550525 DLGLOBAL DEBUG validating counter group 0x7f5204aa0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101550525 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101550525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101550525 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101550526 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101550528 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101550528 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101550528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101550528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:15:51.488727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7795): Terminating (SIGTERM) 10:15:51.528490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7798): Terminating (SIGTERM) 10:15:51.568301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7801): Terminating (SIGTERM) 10:15:51.608393 --- ParallelTerminationStrategy: PID 7795 died... 10:15:51.627880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7795): Terminated: ok {rc=0} 10:15:51.672278 --- ParallelTerminationStrategy: PID 7798 died... 10:15:51.691226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7798): Terminated: ok {rc=0} 10:15:51.735119 --- ParallelTerminationStrategy: PID 7801 died... 10:15:51.753929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7801): Terminated: ok {rc=0} 10:15:51.843744 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:15:53.040387 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:15:53.046832 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:15:53.067469 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:15:53.094497 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:15:53.147642 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:15:53.170546 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:15:53.198848 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:15:53.743143 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:15:53.794163 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:15:53.805438 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:15:53.861840 tst mo_mt_call.py: using LAC 33249 10:15:53.988035 tst mo_mt_call.py: using RAC 99 10:15:54.121331 tst mo_mt_call.py: using CellId 33249 10:15:54.254975 tst mo_mt_call.py: using BVCI 33250 10:15:54.377208 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:15:54.389216 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:15:54.400669 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:15:54.412043 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:15:54.423743 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:15:54.435458 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:15:54.553776 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:15:54.677724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:55.202133 run create_hlr_db(pid=7810): Launched 10:15:55.332027 bus /sierra_2: Setting Powered False 10:15:56.397957 run create_hlr_db(pid=7810): Terminated: ok {rc=0} 10:15:56.847633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7812): Launched 10:15:57.165416 run osmo-hlr_10.42.42.2(pid=7813): Launched 10:15:57.286690 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:57.843134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7815): Launched 10:15:58.161818 run osmo-stp_10.42.42.5(pid=7816): Launched 10:15:58.280673 run osmo-msc_10.42.42.6: Starting osmo-msc 10:15:58.850408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7818): Launched 10:15:59.166727 run osmo-msc_10.42.42.6(pid=7819): Launched 10:15:59.344615 run osmo-stp_10.42.42.5(pid=7816): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7816)] 10:15:59.476123 run osmo-stp_10.42.42.5(pid=7816): stdout: | (launched: 2022-12-13_10:15:58.102045) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:59.607445 run osmo-stp_10.42.42.5(pid=7816): stderr: | 20221213101558277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101558277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101558277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101558277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101558278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101558278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101558278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:59.737330 run osmo-stp_10.42.42.5(pid=7816): stdout: | (launched: 2022-12-13_10:15:58.102045) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:59.861606 run osmo-stp_10.42.42.5(pid=7816): stderr: | 20221213101558277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101558277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101558277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101558277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101558278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101558278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101558278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:00.010517 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7816): Process ended prematurely: osmo-stp_10.42.42.5(pid=7816) [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7816)] [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:16:00.019419 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:16:00.045988 run osmo-hlr_10.42.42.2(pid=7813): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7813)] 10:16:00.094098 run osmo-hlr_10.42.42.2(pid=7813): stdout: | (launched: 2022-12-13_10:15:57.105747) 10:16:00.143741 run osmo-hlr_10.42.42.2(pid=7813): stderr: | 20221213101557284 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101557284 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101557284 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101557285 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101557285 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101557285 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101557297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101557305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101557305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101557305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:00.213075 run osmo-msc_10.42.42.6(pid=7819): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7819)] 10:16:00.261049 run osmo-msc_10.42.42.6(pid=7819): stdout: | (launched: 2022-12-13_10:15:59.106399) 10:16:00.310693 run osmo-msc_10.42.42.6(pid=7819): stderr: | 20221213101559384 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101559384 DLGLOBAL DEBUG validating counter group 0x7f60a3ec2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101559384 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101559384 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101559384 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101559385 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101559386 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101559387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101559387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101559387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:16:00.360886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7812): Terminating (SIGTERM) 10:16:00.400864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7815): Terminating (SIGTERM) 10:16:00.441032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7818): Terminating (SIGTERM) 10:16:00.481600 --- ParallelTerminationStrategy: PID 7812 died... 10:16:00.500928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7812): Terminated: ok {rc=0} 10:16:00.545356 --- ParallelTerminationStrategy: PID 7815 died... 10:16:00.563959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7815): Terminated: ok {rc=0} 10:16:00.608345 --- ParallelTerminationStrategy: PID 7818 died... 10:16:00.627259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7818): Terminated: ok {rc=0} 10:16:00.711991 bus /sierra_3: Setting Powered False 10:16:01.810039 bus /sierra_3: Setting Powered False 10:16:02.926267 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:16:04.079330 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:04.091879 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:16:04.150460 tst mo_mt_call_osmux.py: using LAC 33250 10:16:04.282935 tst mo_mt_call_osmux.py: using RAC 100 10:16:04.415738 tst mo_mt_call_osmux.py: using CellId 33250 10:16:04.546448 tst mo_mt_call_osmux.py: using BVCI 33251 10:16:04.670968 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:04.682601 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:04.694053 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:04.705494 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:04.717157 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:04.728869 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:16:04.853137 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:16:04.973208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:05.463471 run create_hlr_db(pid=7821): Launched 10:16:05.593145 bus /sierra_2: Setting Powered False 10:16:06.655730 run create_hlr_db(pid=7821): Terminated: ok {rc=0} 10:16:07.115764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7823): Launched 10:16:07.455690 run osmo-hlr_10.42.42.2(pid=7824): Launched 10:16:07.585482 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:08.172536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7826): Launched 10:16:08.511062 run osmo-stp_10.42.42.5(pid=7827): Launched 10:16:08.641439 run osmo-msc_10.42.42.6: Starting osmo-msc 10:16:09.249516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7829): Launched 10:16:09.587933 run osmo-msc_10.42.42.6(pid=7830): Launched 10:16:09.776256 run osmo-stp_10.42.42.5(pid=7827): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7827)] 10:16:09.918029 run osmo-stp_10.42.42.5(pid=7827): stdout: | (launched: 2022-12-13_10:16:08.447423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:10.060173 run osmo-stp_10.42.42.5(pid=7827): stderr: | 20221213101608642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101608642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101608642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101608643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101608643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101608643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101608643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:10.200476 run osmo-stp_10.42.42.5(pid=7827): stdout: | (launched: 2022-12-13_10:16:08.447423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:10.334376 run osmo-stp_10.42.42.5(pid=7827): stderr: | 20221213101608642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101608642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101608642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101608643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101608643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101608643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101608643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:10.494106 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7827): Process ended prematurely: osmo-stp_10.42.42.5(pid=7827) [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7827)] [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:16:10.503696 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:16:10.531728 run osmo-hlr_10.42.42.2(pid=7824): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7824)] 10:16:10.583359 run osmo-hlr_10.42.42.2(pid=7824): stdout: | (launched: 2022-12-13_10:16:07.392396) 10:16:10.636556 run osmo-hlr_10.42.42.2(pid=7824): stderr: | 20221213101607590 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101607590 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101607590 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101607590 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101607590 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101607590 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101607602 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101607611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101607611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101607611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:10.710466 run osmo-msc_10.42.42.6(pid=7830): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7830)] 10:16:10.761369 run osmo-msc_10.42.42.6(pid=7830): stdout: | (launched: 2022-12-13_10:16:09.524348) 10:16:10.813916 run osmo-msc_10.42.42.6(pid=7830): stderr: | 20221213101609845 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101609845 DLGLOBAL DEBUG validating counter group 0x7f154dd9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101609845 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101609845 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101609845 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101609846 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101609848 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101609849 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101609849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101609849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:16:10.867053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7823): Terminating (SIGTERM) 10:16:10.909392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7826): Terminating (SIGTERM) 10:16:10.951856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7829): Terminating (SIGTERM) 10:16:10.994596 --- ParallelTerminationStrategy: PID 7823 died... 10:16:11.015269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7823): Terminated: ok {rc=0} 10:16:11.062292 --- ParallelTerminationStrategy: PID 7826 died... 10:16:11.082350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7826): Terminated: ok {rc=0} 10:16:11.129339 --- ParallelTerminationStrategy: PID 7829 died... 10:16:11.149430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7829): Terminated: ok {rc=0} 10:16:11.239002 bus /sierra_3: Setting Powered False 10:16:12.335765 bus /sierra_3: Setting Powered False 10:16:13.454245 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:16:14.687812 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:16:14.694662 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:16:14.715063 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:16:14.741608 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:16:14.793962 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:16:14.815501 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:16:14.843299 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:16:15.389691 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:16:15.440426 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:15.451692 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:16:15.510315 tst mo_mt_call.py: using LAC 33251 10:16:15.633030 tst mo_mt_call.py: using RAC 101 10:16:15.754178 tst mo_mt_call.py: using CellId 33251 10:16:15.879867 tst mo_mt_call.py: using BVCI 33252 10:16:16.021669 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:16.034439 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:16.047111 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:16.059593 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:16.073181 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:16.086985 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:16:16.210719 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:16:16.334093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:16.883841 run create_hlr_db(pid=7836): Launched 10:16:17.050693 bus /sierra_2: Setting Powered False 10:16:18.116747 run create_hlr_db(pid=7836): Terminated: ok {rc=0} 10:16:18.591767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7838): Launched 10:16:18.932893 run osmo-hlr_10.42.42.2(pid=7839): Launched 10:16:19.063117 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:19.649310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7841): Launched 10:16:19.989836 run osmo-stp_10.42.42.5(pid=7842): Launched 10:16:20.117972 run osmo-msc_10.42.42.6: Starting osmo-msc 10:16:20.729026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7844): Launched 10:16:21.069137 run osmo-msc_10.42.42.6(pid=7845): Launched 10:16:21.258396 run osmo-stp_10.42.42.5(pid=7842): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7842)] 10:16:21.400814 run osmo-stp_10.42.42.5(pid=7842): stdout: | (launched: 2022-12-13_10:16:19.926126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:21.543807 run osmo-stp_10.42.42.5(pid=7842): stderr: | 20221213101620118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101620118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101620118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101620119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101620119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101620119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101620119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:21.677727 run osmo-stp_10.42.42.5(pid=7842): stdout: | (launched: 2022-12-13_10:16:19.926126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:21.802376 run osmo-stp_10.42.42.5(pid=7842): stderr: | 20221213101620118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101620118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101620118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101620119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101620119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101620119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101620119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:21.951711 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7842): Process ended prematurely: osmo-stp_10.42.42.5(pid=7842) [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7842)] [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:16:21.960803 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:16:21.987802 run osmo-hlr_10.42.42.2(pid=7839): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7839)] 10:16:22.036733 run osmo-hlr_10.42.42.2(pid=7839): stdout: | (launched: 2022-12-13_10:16:18.869599) 10:16:22.087004 run osmo-hlr_10.42.42.2(pid=7839): stderr: | 20221213101619067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101619067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101619067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101619067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101619067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101619067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101619079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101619088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101619089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101619089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:22.157924 run osmo-msc_10.42.42.6(pid=7845): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7845)] 10:16:22.206510 run osmo-msc_10.42.42.6(pid=7845): stdout: | (launched: 2022-12-13_10:16:21.005100) 10:16:22.256703 run osmo-msc_10.42.42.6(pid=7845): stderr: | 20221213101621327 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101621328 DLGLOBAL DEBUG validating counter group 0x7f5cdfcf3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101621328 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101621328 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101621328 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101621328 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101621330 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101621331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101621331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101621331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:16:22.307137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7838): Terminating (SIGTERM) 10:16:22.347455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7841): Terminating (SIGTERM) 10:16:22.387793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7844): Terminating (SIGTERM) 10:16:22.428310 --- ParallelTerminationStrategy: PID 7838 died... 10:16:22.447989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7838): Terminated: ok {rc=0} 10:16:22.492485 --- ParallelTerminationStrategy: PID 7841 died... 10:16:22.511504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7841): Terminated: ok {rc=0} 10:16:22.555962 --- ParallelTerminationStrategy: PID 7844 died... 10:16:22.575027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7844): Terminated: ok {rc=0} 10:16:22.662563 bus /sierra_3: Setting Powered False 10:16:23.764636 bus /sierra_3: Setting Powered False 10:16:24.881952 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:16:26.032018 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:26.043915 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:16:26.100323 tst mo_mt_call_osmux.py: using LAC 33252 10:16:26.224522 tst mo_mt_call_osmux.py: using RAC 102 10:16:26.348543 tst mo_mt_call_osmux.py: using CellId 33252 10:16:26.471549 tst mo_mt_call_osmux.py: using BVCI 33253 10:16:26.587113 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:26.598334 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:26.609230 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:26.620040 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:26.630968 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:26.641884 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:16:26.766285 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:16:26.893137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:27.419452 run create_hlr_db(pid=7847): Launched 10:16:27.550451 bus /sierra_2: Setting Powered False 10:16:28.617183 run create_hlr_db(pid=7847): Terminated: ok {rc=0} 10:16:29.087591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7849): Launched 10:16:29.428767 run osmo-hlr_10.42.42.2(pid=7850): Launched 10:16:29.559761 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:30.142310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7852): Launched 10:16:30.484379 run osmo-stp_10.42.42.5(pid=7853): Launched 10:16:30.614903 run osmo-msc_10.42.42.6: Starting osmo-msc 10:16:31.231959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7855): Launched 10:16:31.590902 run osmo-msc_10.42.42.6(pid=7856): Launched 10:16:31.932739 run osmo-stp_10.42.42.5(pid=7853): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7853)] 10:16:32.181904 run osmo-stp_10.42.42.5(pid=7853): stdout: | (launched: 2022-12-13_10:16:30.420687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:32.488833 run osmo-stp_10.42.42.5(pid=7853): stderr: | 20221213101630613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101630613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101630613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101630614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101630614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101630614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101630614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:32.620890 run osmo-stp_10.42.42.5(pid=7853): stdout: | (launched: 2022-12-13_10:16:30.420687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:32.746447 run osmo-stp_10.42.42.5(pid=7853): stderr: | 20221213101630613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101630613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101630613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101630614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101630614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101630614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101630614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:32.896190 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7853): Process ended prematurely: osmo-stp_10.42.42.5(pid=7853) [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7853)] [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:16:32.905384 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 10:16:32.932258 run osmo-hlr_10.42.42.2(pid=7850): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7850)] 10:16:32.981363 run osmo-hlr_10.42.42.2(pid=7850): stdout: | (launched: 2022-12-13_10:16:29.365320) 10:16:33.031894 run osmo-hlr_10.42.42.2(pid=7850): stderr: | 20221213101629561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101629562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101629562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101629562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101629562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101629562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101629575 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101629583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101629584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101629584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:33.102949 run osmo-msc_10.42.42.6(pid=7856): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7856)] 10:16:33.152187 run osmo-msc_10.42.42.6(pid=7856): stdout: | (launched: 2022-12-13_10:16:31.525744) 10:16:33.202801 run osmo-msc_10.42.42.6(pid=7856): stderr: | 20221213101632075 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101632076 DLGLOBAL DEBUG validating counter group 0x7f4e77886c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101632076 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101632076 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101632077 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101632077 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101632079 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101632079 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101632079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101632079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:16:33.253793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7849): Terminating (SIGTERM) 10:16:33.294546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7852): Terminating (SIGTERM) 10:16:33.335197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7855): Terminating (SIGTERM) 10:16:33.376368 --- ParallelTerminationStrategy: PID 7849 died... 10:16:33.396400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7849): Terminated: ok {rc=0} 10:16:33.441568 --- ParallelTerminationStrategy: PID 7852 died... 10:16:33.460537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7852): Terminated: ok {rc=0} 10:16:33.505674 --- ParallelTerminationStrategy: PID 7855 died... 10:16:33.525168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7855): Terminated: ok {rc=0} 10:16:33.612542 bus /sierra_3: Setting Powered False 10:16:34.715371 bus /sierra_3: Setting Powered False 10:16:35.833204 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:16:37.072160 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:16:37.079642 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:16:37.100839 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:16:37.131087 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:16:37.184437 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:16:37.206977 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:16:37.234921 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:16:37.779049 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:16:37.829962 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:16:37.841077 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:16:37.901347 tst mo_mt_call.py: using LAC 33253 10:16:38.025577 tst mo_mt_call.py: using RAC 103 10:16:38.148273 tst mo_mt_call.py: using CellId 33253 10:16:38.268930 tst mo_mt_call.py: using BVCI 33254 10:16:38.382262 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:16:38.393396 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:16:38.404167 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:16:38.414972 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:16:38.426016 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:16:38.436727 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:16:38.555173 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:16:38.672859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:39.159394 run create_hlr_db(pid=7861): Launched 10:16:39.289638 bus /sierra_2: Setting Powered False 10:16:40.352087 run create_hlr_db(pid=7861): Terminated: ok {rc=0} 10:16:40.790952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7863): Launched 10:16:41.107911 run osmo-hlr_10.42.42.2(pid=7864): Launched 10:16:41.227370 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:41.783811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7866): Launched 10:16:42.100694 run osmo-stp_10.42.42.5(pid=7867): Launched 10:16:42.221146 run osmo-msc_10.42.42.6: Starting osmo-msc 10:16:42.787007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7869): Launched 10:16:43.102727 run osmo-msc_10.42.42.6(pid=7870): Launched 10:16:43.279458 run osmo-stp_10.42.42.5(pid=7867): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7867)] 10:16:43.411332 run osmo-stp_10.42.42.5(pid=7867): stdout: | (launched: 2022-12-13_10:16:42.040495) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:43.542888 run osmo-stp_10.42.42.5(pid=7867): stderr: | 20221213101642214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101642215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101642215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101642215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101642216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101642216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101642216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:43.673384 run osmo-stp_10.42.42.5(pid=7867): stdout: | (launched: 2022-12-13_10:16:42.040495) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:43.797851 run osmo-stp_10.42.42.5(pid=7867): stderr: | 20221213101642214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101642215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101642215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101642215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101642216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101642216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101642216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:43.946681 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7867): Process ended prematurely: osmo-stp_10.42.42.5(pid=7867) [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7867)] [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:16:43.955631 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:16:43.982122 run osmo-hlr_10.42.42.2(pid=7864): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7864)] 10:16:44.030400 run osmo-hlr_10.42.42.2(pid=7864): stdout: | (launched: 2022-12-13_10:16:41.048259) 10:16:44.080598 run osmo-hlr_10.42.42.2(pid=7864): stderr: | 20221213101641225 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101641225 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101641226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101641226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101641226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101641226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101641238 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101641248 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101641248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101641249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:44.150585 run osmo-msc_10.42.42.6(pid=7870): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7870)] 10:16:44.198971 run osmo-msc_10.42.42.6(pid=7870): stdout: | (launched: 2022-12-13_10:16:43.042568) 10:16:44.248935 run osmo-msc_10.42.42.6(pid=7870): stderr: | 20221213101643315 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101643315 DLGLOBAL DEBUG validating counter group 0x7fb39069ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101643316 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101643316 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101643316 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101643316 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101643318 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101643318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101643318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101643318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:16:44.299436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7863): Terminating (SIGTERM) 10:16:44.339630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7866): Terminating (SIGTERM) 10:16:44.379850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7869): Terminating (SIGTERM) 10:16:44.420352 --- ParallelTerminationStrategy: PID 7863 died... 10:16:44.439675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7863): Terminated: ok {rc=0} 10:16:44.484267 --- ParallelTerminationStrategy: PID 7866 died... 10:16:44.503212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7866): Terminated: ok {rc=0} 10:16:44.547576 --- ParallelTerminationStrategy: PID 7869 died... 10:16:44.566391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7869): Terminated: ok {rc=0} 10:16:44.652787 bus /sierra_3: Setting Powered False 10:16:45.752683 bus /sierra_3: Setting Powered False 10:16:46.884336 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:16:48.054893 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:16:48.067181 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:16:48.125445 tst mo_mt_call_osmux.py: using LAC 33254 10:16:48.259216 tst mo_mt_call_osmux.py: using RAC 104 10:16:48.391855 tst mo_mt_call_osmux.py: using CellId 33254 10:16:48.531828 tst mo_mt_call_osmux.py: using BVCI 33255 10:16:48.656062 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:16:48.667906 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:16:48.679478 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:16:48.691002 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:16:48.702828 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:16:48.714780 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:16:48.834155 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:16:48.958062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:49.484222 run create_hlr_db(pid=7872): Launched 10:16:49.612603 bus /sierra_2: Setting Powered False 10:16:50.678883 run create_hlr_db(pid=7872): Terminated: ok {rc=0} 10:16:51.128212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7874): Launched 10:16:51.446149 run osmo-hlr_10.42.42.2(pid=7875): Launched 10:16:51.565696 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:52.107384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7877): Launched 10:16:52.424242 run osmo-stp_10.42.42.5(pid=7878): Launched 10:16:52.545889 run osmo-msc_10.42.42.6: Starting osmo-msc 10:16:53.113173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7880): Launched 10:16:53.429510 run osmo-msc_10.42.42.6(pid=7881): Launched 10:16:53.605193 run osmo-stp_10.42.42.5(pid=7878): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7878)] 10:16:53.736530 run osmo-stp_10.42.42.5(pid=7878): stdout: | (launched: 2022-12-13_10:16:52.364257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:53.867059 run osmo-stp_10.42.42.5(pid=7878): stderr: | 20221213101652535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101652535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101652535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101652536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101652536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101652536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101652537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:53.996450 run osmo-stp_10.42.42.5(pid=7878): stdout: | (launched: 2022-12-13_10:16:52.364257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:54.120327 run osmo-stp_10.42.42.5(pid=7878): stderr: | 20221213101652535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101652535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101652535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101652536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101652536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101652536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101652537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:54.268883 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7878): Process ended prematurely: osmo-stp_10.42.42.5(pid=7878) [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7878)] [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:16:54.277811 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:16:54.304368 run osmo-hlr_10.42.42.2(pid=7875): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7875)] 10:16:54.359324 run osmo-hlr_10.42.42.2(pid=7875): stdout: | (launched: 2022-12-13_10:16:51.386319) 10:16:54.409347 run osmo-hlr_10.42.42.2(pid=7875): stderr: | 20221213101651563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101651563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101651563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101651563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101651563 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101651563 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101651576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101651585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101651585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101651585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:54.479243 run osmo-msc_10.42.42.6(pid=7881): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7881)] 10:16:54.527388 run osmo-msc_10.42.42.6(pid=7881): stdout: | (launched: 2022-12-13_10:16:53.368272) 10:16:54.577276 run osmo-msc_10.42.42.6(pid=7881): stderr: | 20221213101653642 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101653642 DLGLOBAL DEBUG validating counter group 0x7ff7e09fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101653642 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101653642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101653643 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101653643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101653644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101653645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101653645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101653645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:16:54.627655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7874): Terminating (SIGTERM) 10:16:54.667858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7877): Terminating (SIGTERM) 10:16:54.707814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7880): Terminating (SIGTERM) 10:16:54.748104 --- ParallelTerminationStrategy: PID 7874 died... 10:16:54.767570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7874): Terminated: ok {rc=0} 10:16:54.812155 --- ParallelTerminationStrategy: PID 7877 died... 10:16:54.831201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7877): Terminated: ok {rc=0} 10:16:54.875797 --- ParallelTerminationStrategy: PID 7880 died... 10:16:54.894614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7880): Terminated: ok {rc=0} 10:16:54.981767 bus /sierra_3: Setting Powered False 10:16:56.082278 bus /sierra_3: Setting Powered False 10:16:57.198809 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:16:58.434456 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:16:58.440918 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:16:58.461392 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:16:58.488006 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:16:58.540171 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:16:58.560767 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:16:58.587108 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:16:59.135290 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:16:59.185988 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:16:59.197287 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:16:59.253795 tst mo_mt_call.py: using LAC 33255 10:16:59.378735 tst mo_mt_call.py: using RAC 105 10:16:59.504048 tst mo_mt_call.py: using CellId 33255 10:16:59.629065 tst mo_mt_call.py: using BVCI 33256 10:16:59.744498 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:16:59.755641 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:16:59.766590 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:16:59.777419 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:16:59.788352 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:16:59.799398 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:16:59.923691 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:17:00.044412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:00.535011 run create_hlr_db(pid=7886): Launched 10:17:00.664687 bus /sierra_2: Setting Powered False 10:17:01.755971 run create_hlr_db(pid=7886): Terminated: ok {rc=0} 10:17:02.253012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7891): Launched 10:17:02.605096 run osmo-hlr_10.42.42.2(pid=7892): Launched 10:17:02.735160 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:03.322442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7894): Launched 10:17:03.660906 run osmo-stp_10.42.42.5(pid=7895): Launched 10:17:03.791443 run osmo-msc_10.42.42.6: Starting osmo-msc 10:17:04.401728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7897): Launched 10:17:04.740470 run osmo-msc_10.42.42.6(pid=7898): Launched 10:17:04.928242 run osmo-stp_10.42.42.5(pid=7895): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7895)] 10:17:05.069789 run osmo-stp_10.42.42.5(pid=7895): stdout: | (launched: 2022-12-13_10:17:03.597509) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:05.212657 run osmo-stp_10.42.42.5(pid=7895): stderr: | 20221213101703789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101703790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101703790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101703790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101703791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101703791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101703791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:05.352598 run osmo-stp_10.42.42.5(pid=7895): stdout: | (launched: 2022-12-13_10:17:03.597509) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:05.486639 run osmo-stp_10.42.42.5(pid=7895): stderr: | 20221213101703789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101703790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101703790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101703790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101703791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101703791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101703791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:05.647621 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7895): Process ended prematurely: osmo-stp_10.42.42.5(pid=7895) [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7895)] [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:17:05.657438 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:17:05.685316 run osmo-hlr_10.42.42.2(pid=7892): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7892)] 10:17:05.736703 run osmo-hlr_10.42.42.2(pid=7892): stdout: | (launched: 2022-12-13_10:17:02.541375) 10:17:05.789805 run osmo-hlr_10.42.42.2(pid=7892): stderr: | 20221213101702738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101702738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101702738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101702738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101702738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101702738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101702750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101702759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101702759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101702759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:05.863302 run osmo-msc_10.42.42.6(pid=7898): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7898)] 10:17:05.914104 run osmo-msc_10.42.42.6(pid=7898): stdout: | (launched: 2022-12-13_10:17:04.676788) 10:17:05.966762 run osmo-msc_10.42.42.6(pid=7898): stderr: | 20221213101704997 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101704998 DLGLOBAL DEBUG validating counter group 0x7fce21a16c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101704998 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101704998 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101704998 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101704999 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101705000 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101705001 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101705001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101705001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:17:06.020337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7891): Terminating (SIGTERM) 10:17:06.062545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7894): Terminating (SIGTERM) 10:17:06.105502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7897): Terminating (SIGTERM) 10:17:06.148308 --- ParallelTerminationStrategy: PID 7891 died... 10:17:06.168866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7891): Terminated: ok {rc=0} 10:17:06.216377 --- ParallelTerminationStrategy: PID 7894 died... 10:17:06.236635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7894): Terminated: ok {rc=0} 10:17:06.283659 --- ParallelTerminationStrategy: PID 7897 died... 10:17:06.303643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7897): Terminated: ok {rc=0} 10:17:06.391772 bus /sierra_3: Setting Powered False 10:17:07.491580 bus /sierra_3: Setting Powered False 10:17:08.608705 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:17:09.761565 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:09.774121 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:17:09.832740 tst mo_mt_call_osmux.py: using LAC 33256 10:17:09.965105 tst mo_mt_call_osmux.py: using RAC 106 10:17:10.098606 tst mo_mt_call_osmux.py: using CellId 33256 10:17:10.230558 tst mo_mt_call_osmux.py: using BVCI 33257 10:17:10.353154 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:10.364664 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:10.376036 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:10.387352 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:10.399068 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:10.410709 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:17:10.530308 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:17:10.653908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:11.179973 run create_hlr_db(pid=7900): Launched 10:17:11.311187 bus /sierra_2: Setting Powered False 10:17:12.377040 run create_hlr_db(pid=7900): Terminated: ok {rc=0} 10:17:12.829142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7902): Launched 10:17:13.146622 run osmo-hlr_10.42.42.2(pid=7903): Launched 10:17:13.266752 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:13.810659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7905): Launched 10:17:14.126324 run osmo-stp_10.42.42.5(pid=7906): Launched 10:17:14.244540 run osmo-msc_10.42.42.6: Starting osmo-msc 10:17:14.812791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7908): Launched 10:17:15.129937 run osmo-msc_10.42.42.6(pid=7909): Launched 10:17:15.304074 run osmo-stp_10.42.42.5(pid=7906): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7906)] 10:17:15.435669 run osmo-stp_10.42.42.5(pid=7906): stdout: | (launched: 2022-12-13_10:17:14.066347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:15.567124 run osmo-stp_10.42.42.5(pid=7906): stderr: | 20221213101714238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101714239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101714239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101714239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101714240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101714240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101714240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:15.697383 run osmo-stp_10.42.42.5(pid=7906): stdout: | (launched: 2022-12-13_10:17:14.066347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:15.821859 run osmo-stp_10.42.42.5(pid=7906): stderr: | 20221213101714238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101714239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101714239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101714239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101714240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101714240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101714240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:16.003602 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7906): Process ended prematurely: osmo-stp_10.42.42.5(pid=7906) [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7906)] [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:17:16.014603 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:17:16.044474 run osmo-hlr_10.42.42.2(pid=7903): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7903)] 10:17:16.100193 run osmo-hlr_10.42.42.2(pid=7903): stdout: | (launched: 2022-12-13_10:17:13.086641) 10:17:16.155826 run osmo-hlr_10.42.42.2(pid=7903): stderr: | 20221213101713266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101713266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101713266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101713266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101713266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101713266 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101713279 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101713289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101713289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101713289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:16.234978 run osmo-msc_10.42.42.6(pid=7909): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7909)] 10:17:16.288658 run osmo-msc_10.42.42.6(pid=7909): stdout: | (launched: 2022-12-13_10:17:15.070136) 10:17:16.349321 run osmo-msc_10.42.42.6(pid=7909): stderr: | 20221213101715343 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101715343 DLGLOBAL DEBUG validating counter group 0x7f6ca3c5dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101715343 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101715343 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101715344 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101715344 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101715346 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101715346 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101715346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101715346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:17:16.405709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7902): Terminating (SIGTERM) 10:17:16.450946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7905): Terminating (SIGTERM) 10:17:16.498009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7908): Terminating (SIGTERM) 10:17:16.546017 --- ParallelTerminationStrategy: PID 7902 died... 10:17:16.568154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7902): Terminated: ok {rc=0} 10:17:16.620979 --- ParallelTerminationStrategy: PID 7905 died... 10:17:16.641776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7905): Terminated: ok {rc=0} 10:17:16.691234 --- ParallelTerminationStrategy: PID 7908 died... 10:17:16.712630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7908): Terminated: ok {rc=0} 10:17:16.808804 bus /sierra_3: Setting Powered False 10:17:17.909838 bus /sierra_3: Setting Powered False 10:17:19.026907 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:17:20.264682 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:17:20.271899 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:17:20.293105 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:17:20.321410 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:17:20.374974 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:17:20.396390 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:17:20.424040 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:17:20.971048 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:17:21.020823 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:21.031918 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:17:21.087906 tst mo_mt_call.py: using LAC 33257 10:17:21.210315 tst mo_mt_call.py: using RAC 107 10:17:21.332898 tst mo_mt_call.py: using CellId 33257 10:17:21.455237 tst mo_mt_call.py: using BVCI 33258 10:17:21.568422 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:21.579616 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:21.590536 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:21.601393 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:21.612248 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:21.623358 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:17:21.741562 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:17:21.858938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:22.339773 run create_hlr_db(pid=7914): Launched 10:17:22.467407 bus /sierra_2: Setting Powered False 10:17:23.529244 run create_hlr_db(pid=7914): Terminated: ok {rc=0} 10:17:23.991149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7916): Launched 10:17:24.331809 run osmo-hlr_10.42.42.2(pid=7917): Launched 10:17:24.460211 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:25.045935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7919): Launched 10:17:25.387302 run osmo-stp_10.42.42.5(pid=7920): Launched 10:17:25.517190 run osmo-msc_10.42.42.6: Starting osmo-msc 10:17:26.128640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7922): Launched 10:17:26.468252 run osmo-msc_10.42.42.6(pid=7923): Launched 10:17:26.658049 run osmo-stp_10.42.42.5(pid=7920): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7920)] 10:17:26.799752 run osmo-stp_10.42.42.5(pid=7920): stdout: | (launched: 2022-12-13_10:17:25.323789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:26.942149 run osmo-stp_10.42.42.5(pid=7920): stderr: | 20221213101725515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101725515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101725516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101725516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101725517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101725517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101725517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:27.082219 run osmo-stp_10.42.42.5(pid=7920): stdout: | (launched: 2022-12-13_10:17:25.323789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:27.216426 run osmo-stp_10.42.42.5(pid=7920): stderr: | 20221213101725515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101725515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101725516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101725516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101725517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101725517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101725517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:27.377391 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7920): Process ended prematurely: osmo-stp_10.42.42.5(pid=7920) [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7920)] [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:17:27.386989 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:17:27.415187 run osmo-hlr_10.42.42.2(pid=7917): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7917)] 10:17:27.466764 run osmo-hlr_10.42.42.2(pid=7917): stdout: | (launched: 2022-12-13_10:17:24.268663) 10:17:27.520425 run osmo-hlr_10.42.42.2(pid=7917): stderr: | 20221213101724466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101724466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101724467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101724467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101724467 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101724467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101724479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101724487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101724488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101724488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:27.594165 run osmo-msc_10.42.42.6(pid=7923): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7923)] 10:17:27.644707 run osmo-msc_10.42.42.6(pid=7923): stdout: | (launched: 2022-12-13_10:17:26.404378) 10:17:27.697629 run osmo-msc_10.42.42.6(pid=7923): stderr: | 20221213101726725 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101726726 DLGLOBAL DEBUG validating counter group 0x7f6b0faa3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101726726 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101726726 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101726726 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101726726 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101726728 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101726729 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101726729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101726729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:17:27.750821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7916): Terminating (SIGTERM) 10:17:27.793187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7919): Terminating (SIGTERM) 10:17:27.836004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7922): Terminating (SIGTERM) 10:17:27.879207 --- ParallelTerminationStrategy: PID 7916 died... 10:17:27.899960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7916): Terminated: ok {rc=0} 10:17:27.947038 --- ParallelTerminationStrategy: PID 7919 died... 10:17:27.967292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7919): Terminated: ok {rc=0} 10:17:28.014497 --- ParallelTerminationStrategy: PID 7922 died... 10:17:28.034648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7922): Terminated: ok {rc=0} 10:17:28.124248 bus /sierra_3: Setting Powered False 10:17:29.224199 bus /sierra_3: Setting Powered False 10:17:30.342615 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:17:31.501448 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:31.514857 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:17:31.577660 tst mo_mt_call_osmux.py: using LAC 33258 10:17:31.712276 tst mo_mt_call_osmux.py: using RAC 108 10:17:31.887934 tst mo_mt_call_osmux.py: using CellId 33258 10:17:32.013010 tst mo_mt_call_osmux.py: using BVCI 33259 10:17:32.142735 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:32.155631 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:32.168296 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:32.182060 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:32.195451 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:32.208862 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:17:32.337891 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:17:32.456568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:32.984108 run create_hlr_db(pid=7925): Launched 10:17:33.114306 bus /sierra_2: Setting Powered False 10:17:34.176265 run create_hlr_db(pid=7925): Terminated: ok {rc=0} 10:17:34.636918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7927): Launched 10:17:34.974443 run osmo-hlr_10.42.42.2(pid=7928): Launched 10:17:35.103610 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:35.688569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7930): Launched 10:17:36.026249 run osmo-stp_10.42.42.5(pid=7931): Launched 10:17:36.154321 run osmo-msc_10.42.42.6: Starting osmo-msc 10:17:36.763517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7933): Launched 10:17:37.103012 run osmo-msc_10.42.42.6(pid=7934): Launched 10:17:37.290364 run osmo-stp_10.42.42.5(pid=7931): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7931)] 10:17:37.431740 run osmo-stp_10.42.42.5(pid=7931): stdout: | (launched: 2022-12-13_10:17:35.962672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:37.573805 run osmo-stp_10.42.42.5(pid=7931): stderr: | 20221213101736155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101736155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101736155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101736155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101736156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101736156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101736156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:37.713169 run osmo-stp_10.42.42.5(pid=7931): stdout: | (launched: 2022-12-13_10:17:35.962672) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:37.847057 run osmo-stp_10.42.42.5(pid=7931): stderr: | 20221213101736155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101736155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101736155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101736155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101736156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101736156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101736156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:38.007327 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7931): Process ended prematurely: osmo-stp_10.42.42.5(pid=7931) [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7931)] [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:17:38.016877 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:17:38.045491 run osmo-hlr_10.42.42.2(pid=7928): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7928)] 10:17:38.097377 run osmo-hlr_10.42.42.2(pid=7928): stdout: | (launched: 2022-12-13_10:17:34.911017) 10:17:38.150795 run osmo-hlr_10.42.42.2(pid=7928): stderr: | 20221213101735109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101735109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101735109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101735109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101735109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101735109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101735121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101735130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101735130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101735130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:38.224630 run osmo-msc_10.42.42.6(pid=7934): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7934)] 10:17:38.275940 run osmo-msc_10.42.42.6(pid=7934): stdout: | (launched: 2022-12-13_10:17:37.039114) 10:17:38.329151 run osmo-msc_10.42.42.6(pid=7934): stderr: | 20221213101737362 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101737362 DLGLOBAL DEBUG validating counter group 0x7fc0a952bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101737362 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101737362 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101737362 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101737362 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101737364 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101737364 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101737365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101737365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:17:38.382549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7927): Terminating (SIGTERM) 10:17:38.425283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7930): Terminating (SIGTERM) 10:17:38.468164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7933): Terminating (SIGTERM) 10:17:38.511259 --- ParallelTerminationStrategy: PID 7927 died... 10:17:38.532024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7927): Terminated: ok {rc=0} 10:17:38.579354 --- ParallelTerminationStrategy: PID 7930 died... 10:17:38.599548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7930): Terminated: ok {rc=0} 10:17:38.646738 --- ParallelTerminationStrategy: PID 7933 died... 10:17:38.666941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7933): Terminated: ok {rc=0} 10:17:38.757381 bus /sierra_3: Setting Powered False 10:17:39.858456 bus /sierra_3: Setting Powered False 10:17:40.977827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:17:42.215560 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:17:42.222067 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:17:42.242496 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:17:42.268768 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:17:42.320220 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:17:42.340777 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:17:42.367146 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:17:42.917354 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:17:42.969556 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:17:42.980735 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:17:43.037068 tst mo_mt_call.py: using LAC 33259 10:17:43.160492 tst mo_mt_call.py: using RAC 109 10:17:43.285411 tst mo_mt_call.py: using CellId 33259 10:17:43.409389 tst mo_mt_call.py: using BVCI 33260 10:17:43.522692 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:17:43.533889 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:17:43.544695 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:17:43.555517 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:17:43.566478 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:17:43.577556 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:17:43.701739 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:17:43.820841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:44.309388 run create_hlr_db(pid=7939): Launched 10:17:44.436832 bus /sierra_2: Setting Powered False 10:17:45.503039 run create_hlr_db(pid=7939): Terminated: ok {rc=0} 10:17:45.977720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7941): Launched 10:17:46.309626 run osmo-hlr_10.42.42.2(pid=7942): Launched 10:17:46.568624 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:47.223005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7944): Launched 10:17:47.543458 run osmo-stp_10.42.42.5(pid=7945): Launched 10:17:47.664053 run osmo-msc_10.42.42.6: Starting osmo-msc 10:17:48.230705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7947): Launched 10:17:48.548662 run osmo-msc_10.42.42.6(pid=7948): Launched 10:17:48.725777 run osmo-stp_10.42.42.5(pid=7945): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7945)] 10:17:48.857773 run osmo-stp_10.42.42.5(pid=7945): stdout: | (launched: 2022-12-13_10:17:47.483428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:48.989705 run osmo-stp_10.42.42.5(pid=7945): stderr: | 20221213101747655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101747655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101747655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101747656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101747656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101747657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101747657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:49.120379 run osmo-stp_10.42.42.5(pid=7945): stdout: | (launched: 2022-12-13_10:17:47.483428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:49.245700 run osmo-stp_10.42.42.5(pid=7945): stderr: | 20221213101747655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101747655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101747655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101747656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101747656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101747657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101747657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:49.395048 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7945): Process ended prematurely: osmo-stp_10.42.42.5(pid=7945) [trial-2388↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7945)] [trial-2388↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:17:49.404254 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:17:49.431135 run osmo-hlr_10.42.42.2(pid=7942): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7942)] 10:17:49.479757 run osmo-hlr_10.42.42.2(pid=7942): stdout: | (launched: 2022-12-13_10:17:46.246484) 10:17:49.529979 run osmo-hlr_10.42.42.2(pid=7942): stderr: | 20221213101746516 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101746516 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101746516 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101746516 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101746516 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101746516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101746539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101746556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101746556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101746556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:49.599909 run osmo-msc_10.42.42.6(pid=7948): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7948)] 10:17:49.648158 run osmo-msc_10.42.42.6(pid=7948): stdout: | (launched: 2022-12-13_10:17:48.488740) 10:17:49.698299 run osmo-msc_10.42.42.6(pid=7948): stderr: | 20221213101748762 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101748762 DLGLOBAL DEBUG validating counter group 0x7fe943884c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101748762 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101748762 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101748762 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101748762 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101748764 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101748764 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101748765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101748765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:17:49.748775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7941): Terminating (SIGTERM) 10:17:49.789142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7944): Terminating (SIGTERM) 10:17:49.829426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7947): Terminating (SIGTERM) 10:17:49.869957 --- ParallelTerminationStrategy: PID 7941 died... 10:17:49.889343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7941): Terminated: ok {rc=0} 10:17:49.933586 --- ParallelTerminationStrategy: PID 7944 died... 10:17:49.952549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7944): Terminated: ok {rc=0} 10:17:49.997172 --- ParallelTerminationStrategy: PID 7947 died... 10:17:50.016039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7947): Terminated: ok {rc=0} 10:17:50.102666 bus /sierra_3: Setting Powered False 10:17:51.203907 bus /sierra_3: Setting Powered False 10:17:52.322708 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:17:53.477219 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:17:53.489766 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:17:53.548194 tst mo_mt_call_osmux.py: using LAC 33260 10:17:53.679917 tst mo_mt_call_osmux.py: using RAC 110 10:17:53.811474 tst mo_mt_call_osmux.py: using CellId 33260 10:17:53.945110 tst mo_mt_call_osmux.py: using BVCI 33261 10:17:54.069436 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:17:54.081493 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:17:54.092914 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:17:54.104351 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:17:54.116114 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:17:54.127913 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:17:54.248515 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:17:54.372677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:54.898692 run create_hlr_db(pid=7950): Launched 10:17:55.027283 bus /sierra_2: Setting Powered False 10:17:56.093093 run create_hlr_db(pid=7950): Terminated: ok {rc=0} 10:17:56.544876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7952): Launched 10:17:56.860533 run osmo-hlr_10.42.42.2(pid=7953): Launched 10:17:56.980446 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:57.535341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7955): Launched 10:17:57.850972 run osmo-stp_10.42.42.5(pid=7956): Launched 10:17:57.971283 run osmo-msc_10.42.42.6: Starting osmo-msc 10:17:58.541785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7958): Launched 10:17:58.859577 run osmo-msc_10.42.42.6(pid=7959): Launched 10:17:59.034492 run osmo-stp_10.42.42.5(pid=7956): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7956)] 10:17:59.165985 run osmo-stp_10.42.42.5(pid=7956): stdout: | (launched: 2022-12-13_10:17:57.791041) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:59.297912 run osmo-stp_10.42.42.5(pid=7956): stderr: | 20221213101757963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101757963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101757963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101757963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101757964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101757964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101757964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:59.428590 run osmo-stp_10.42.42.5(pid=7956): stdout: | (launched: 2022-12-13_10:17:57.791041) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:59.553943 run osmo-stp_10.42.42.5(pid=7956): stderr: | 20221213101757963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101757963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101757963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101757963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101757964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101757964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101757964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:59.704263 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7956): Process ended prematurely: osmo-stp_10.42.42.5(pid=7956) [trial-2388↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7956)] [trial-2388↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:17:59.713405 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:17:59.740557 run osmo-hlr_10.42.42.2(pid=7953): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7953)] 10:17:59.789578 run osmo-hlr_10.42.42.2(pid=7953): stdout: | (launched: 2022-12-13_10:17:56.800753) 10:17:59.840048 run osmo-hlr_10.42.42.2(pid=7953): stderr: | 20221213101756979 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101756979 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101756979 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101756979 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101756979 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101756979 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101756993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101757003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101757003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101757003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:59.910690 run osmo-msc_10.42.42.6(pid=7959): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7959)] 10:17:59.959396 run osmo-msc_10.42.42.6(pid=7959): stdout: | (launched: 2022-12-13_10:17:58.799500) 10:18:00.009774 run osmo-msc_10.42.42.6(pid=7959): stderr: | 20221213101759073 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101759073 DLGLOBAL DEBUG validating counter group 0x7fae199fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101759073 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101759073 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101759074 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101759074 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101759075 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101759076 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101759076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101759076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:00.060590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7952): Terminating (SIGTERM) 10:18:00.101305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7955): Terminating (SIGTERM) 10:18:00.142054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7958): Terminating (SIGTERM) 10:18:00.183040 --- ParallelTerminationStrategy: PID 7952 died... 10:18:00.202883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7952): Terminated: ok {rc=0} 10:18:00.248425 --- ParallelTerminationStrategy: PID 7955 died... 10:18:00.267665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7955): Terminated: ok {rc=0} 10:18:00.312622 --- ParallelTerminationStrategy: PID 7958 died... 10:18:00.331967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7958): Terminated: ok {rc=0} 10:18:00.419954 bus /sierra_3: Setting Powered False 10:18:01.531592 bus /sierra_3: Setting Powered False 10:18:02.666275 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:18:03.901199 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:18:03.907225 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:18:03.927591 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:18:03.953987 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:18:04.007867 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:18:04.030374 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:18:04.058694 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:18:04.602256 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:18:04.653420 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:04.664405 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:18:04.721219 tst mo_mt_call.py: using LAC 33261 10:18:04.846214 tst mo_mt_call.py: using RAC 111 10:18:04.969370 tst mo_mt_call.py: using CellId 33261 10:18:05.094699 tst mo_mt_call.py: using BVCI 33262 10:18:05.210382 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:05.221391 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:05.232107 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:05.243257 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:05.254153 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:05.265023 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:18:05.388666 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:18:05.512037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:06.038912 run create_hlr_db(pid=7965): Launched 10:18:06.169823 bus /sierra_2: Setting Powered False 10:18:07.236335 run create_hlr_db(pid=7965): Terminated: ok {rc=0} 10:18:07.688211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7967): Launched 10:18:08.006461 run osmo-hlr_10.42.42.2(pid=7968): Launched 10:18:08.126582 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:08.682751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7970): Launched 10:18:08.999303 run osmo-stp_10.42.42.5(pid=7971): Launched 10:18:09.120325 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:09.688117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7973): Launched 10:18:10.006309 run osmo-msc_10.42.42.6(pid=7974): Launched 10:18:10.183233 run osmo-stp_10.42.42.5(pid=7971): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7971)] 10:18:10.315163 run osmo-stp_10.42.42.5(pid=7971): stdout: | (launched: 2022-12-13_10:18:08.939362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:10.446278 run osmo-stp_10.42.42.5(pid=7971): stderr: | 20221213101809110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101809110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101809110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101809111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101809111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101809111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101809111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:10.576236 run osmo-stp_10.42.42.5(pid=7971): stdout: | (launched: 2022-12-13_10:18:08.939362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:10.700505 run osmo-stp_10.42.42.5(pid=7971): stderr: | 20221213101809110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101809110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101809110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101809111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101809111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101809111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101809111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:10.849512 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7971): Process ended prematurely: osmo-stp_10.42.42.5(pid=7971) [trial-2388↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7971)] [trial-2388↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:18:10.858418 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:18:10.885312 run osmo-hlr_10.42.42.2(pid=7968): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7968)] 10:18:10.933604 run osmo-hlr_10.42.42.2(pid=7968): stdout: | (launched: 2022-12-13_10:18:07.946583) 10:18:10.983709 run osmo-hlr_10.42.42.2(pid=7968): stderr: | 20221213101808123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101808123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101808124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101808124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101808124 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101808124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101808136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101808144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101808144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101808144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:11.053911 run osmo-msc_10.42.42.6(pid=7974): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7974)] 10:18:11.102359 run osmo-msc_10.42.42.6(pid=7974): stdout: | (launched: 2022-12-13_10:18:09.946035) 10:18:11.154839 run osmo-msc_10.42.42.6(pid=7974): stderr: | 20221213101810219 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101810220 DLGLOBAL DEBUG validating counter group 0x7f1d2a781c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101810220 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101810220 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101810220 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101810220 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101810222 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101810222 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101810222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101810222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:11.205371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7967): Terminating (SIGTERM) 10:18:11.245682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7970): Terminating (SIGTERM) 10:18:11.285905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7973): Terminating (SIGTERM) 10:18:11.326484 --- ParallelTerminationStrategy: PID 7967 died... 10:18:11.346237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7967): Terminated: ok {rc=0} 10:18:11.391026 --- ParallelTerminationStrategy: PID 7970 died... 10:18:11.409885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7970): Terminated: ok {rc=0} 10:18:11.454760 --- ParallelTerminationStrategy: PID 7973 died... 10:18:11.473826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7973): Terminated: ok {rc=0} 10:18:11.558588 bus /sierra_3: Setting Powered False 10:18:12.655207 bus /sierra_3: Setting Powered False 10:18:13.771098 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:18:14.916937 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:14.928686 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:18:14.985885 tst mo_mt_call_osmux.py: using LAC 33262 10:18:15.110236 tst mo_mt_call_osmux.py: using RAC 112 10:18:15.235407 tst mo_mt_call_osmux.py: using CellId 33262 10:18:15.364161 tst mo_mt_call_osmux.py: using BVCI 33263 10:18:15.478697 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:15.489869 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:15.500566 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:15.511442 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:15.522256 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:15.532904 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:18:15.652251 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:18:15.774344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:16.317807 run create_hlr_db(pid=7976): Launched 10:18:16.486879 bus /sierra_2: Setting Powered False 10:18:17.552300 run create_hlr_db(pid=7976): Terminated: ok {rc=0} 10:18:18.031406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7978): Launched 10:18:18.368673 run osmo-hlr_10.42.42.2(pid=7979): Launched 10:18:18.497535 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:19.078576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7981): Launched 10:18:19.417131 run osmo-stp_10.42.42.5(pid=7982): Launched 10:18:19.545692 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:20.154674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7984): Launched 10:18:20.494633 run osmo-msc_10.42.42.6(pid=7985): Launched 10:18:20.683060 run osmo-stp_10.42.42.5(pid=7982): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7982)] 10:18:20.824901 run osmo-stp_10.42.42.5(pid=7982): stdout: | (launched: 2022-12-13_10:18:19.354113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:20.967628 run osmo-stp_10.42.42.5(pid=7982): stderr: | 20221213101819545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101819545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101819545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101819546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101819546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101819546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101819546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:21.107746 run osmo-stp_10.42.42.5(pid=7982): stdout: | (launched: 2022-12-13_10:18:19.354113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:21.242245 run osmo-stp_10.42.42.5(pid=7982): stderr: | 20221213101819545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101819545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101819545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101819546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101819546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101819546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101819546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:21.403204 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7982): Process ended prematurely: osmo-stp_10.42.42.5(pid=7982) [trial-2388↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7982)] [trial-2388↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:18:21.412795 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:18:21.440869 run osmo-hlr_10.42.42.2(pid=7979): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7979)] 10:18:21.492808 run osmo-hlr_10.42.42.2(pid=7979): stdout: | (launched: 2022-12-13_10:18:18.305570) 10:18:21.546113 run osmo-hlr_10.42.42.2(pid=7979): stderr: | 20221213101818504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101818504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101818504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101818505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101818505 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101818505 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101818516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101818526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101818527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101818527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:21.620014 run osmo-msc_10.42.42.6(pid=7985): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7985)] 10:18:21.670755 run osmo-msc_10.42.42.6(pid=7985): stdout: | (launched: 2022-12-13_10:18:20.430995) 10:18:21.723798 run osmo-msc_10.42.42.6(pid=7985): stderr: | 20221213101820751 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101820752 DLGLOBAL DEBUG validating counter group 0x7fdf86259c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101820752 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101820752 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101820752 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101820752 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101820754 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101820755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101820755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101820755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:21.777158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7978): Terminating (SIGTERM) 10:18:21.819495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7981): Terminating (SIGTERM) 10:18:21.862425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7984): Terminating (SIGTERM) 10:18:21.905887 --- ParallelTerminationStrategy: PID 7978 died... 10:18:21.927010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7978): Terminated: ok {rc=0} 10:18:21.974145 --- ParallelTerminationStrategy: PID 7981 died... 10:18:21.994381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7981): Terminated: ok {rc=0} 10:18:22.041291 --- ParallelTerminationStrategy: PID 7984 died... 10:18:22.061492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7984): Terminated: ok {rc=0} 10:18:22.149626 bus /sierra_3: Setting Powered False 10:18:23.248838 bus /sierra_3: Setting Powered False 10:18:24.363096 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 emergency:oc2g --------------------------------------------------------------------- 10:18:25.597758 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:18:25.602992 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 10:18:25.624656 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 10:18:25.653554 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 10:18:25.741616 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 10:18:25.763409 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 10:18:25.790791 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 10:18:26.372648 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2388 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 10:18:26.378609 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:18:26.389987 tst emergency:oc2g: Using 1 x bts (candidates: 1) 10:18:26.426343 tst emergency_mo_mt_call.py: using LAC 33263 10:18:26.560728 tst emergency_mo_mt_call.py: using RAC 113 10:18:26.689784 tst emergency_mo_mt_call.py: using CellId 33263 10:18:26.821423 tst emergency_mo_mt_call.py: using BVCI 33264 10:18:26.934541 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:18:26.945377 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:18:26.956063 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:18:26.966647 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:18:26.977520 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:18:26.988195 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:18:27.109964 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:18:27.227491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:27.709810 run create_hlr_db(pid=7990): Launched 10:18:27.836394 bus /sierra_2: Setting Powered False 10:18:28.898380 run create_hlr_db(pid=7990): Terminated: ok {rc=0} 10:18:29.330895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7992): Launched 10:18:29.642977 run osmo-hlr_10.42.42.2(pid=7993): Launched 10:18:29.761079 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:30.292412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7995): Launched 10:18:30.606200 run osmo-stp_10.42.42.5(pid=7996): Launched 10:18:30.734972 tst emergency_mo_mt_call.py: using MSISDN 8107 10:18:30.915788 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:31.483280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7998): Launched 10:18:31.801674 run osmo-msc_10.42.42.6(pid=7999): Launched 10:18:32.149057 run osmo-stp_10.42.42.5(pid=7996): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7996)] 10:18:32.384062 run osmo-stp_10.42.42.5(pid=7996): stdout: | (launched: 2022-12-13_10:18:30.547190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:32.526347 run osmo-stp_10.42.42.5(pid=7996): stderr: | 20221213101830717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101830717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101830717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101830718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101830718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101830718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101830718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:32.666024 run osmo-stp_10.42.42.5(pid=7996): stdout: | (launched: 2022-12-13_10:18:30.547190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:32.799235 run osmo-stp_10.42.42.5(pid=7996): stderr: | 20221213101830717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101830717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101830717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101830718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101830718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101830718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101830718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:32.958035 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7996): Process ended prematurely: osmo-stp_10.42.42.5(pid=7996) [trial-2388↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7996)] [trial-2388↪emergency:oc2g↪emergency_mo_mt_call.py:19] 10:18:32.967340 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 10:18:32.995567 run osmo-hlr_10.42.42.2(pid=7993): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7993)] 10:18:33.047636 run osmo-hlr_10.42.42.2(pid=7993): stdout: | (launched: 2022-12-13_10:18:29.583968) 10:18:33.101939 run osmo-hlr_10.42.42.2(pid=7993): stderr: | 20221213101829761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101829761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101829762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101829762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101829762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101829762 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101829774 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101829783 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101829783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101829783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:33.176415 run osmo-msc_10.42.42.6(pid=7999): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7999)] 10:18:33.227490 run osmo-msc_10.42.42.6(pid=7999): stdout: | (launched: 2022-12-13_10:18:31.740603) 10:18:33.281664 run osmo-msc_10.42.42.6(pid=7999): stderr: | 20221213101832248 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101832248 DLGLOBAL DEBUG validating counter group 0x7fd2a4875c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101832248 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101832248 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101832248 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101832248 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101832250 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101832251 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101832251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101832251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:33.335489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7992): Terminating (SIGTERM) 10:18:33.378529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7995): Terminating (SIGTERM) 10:18:33.422209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7998): Terminating (SIGTERM) 10:18:33.465852 --- ParallelTerminationStrategy: PID 7992 died... 10:18:33.487006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7992): Terminated: ok {rc=0} 10:18:33.534800 --- ParallelTerminationStrategy: PID 7995 died... 10:18:33.555496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7995): Terminated: ok {rc=0} 10:18:33.603178 --- ParallelTerminationStrategy: PID 7998 died... 10:18:33.623826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7998): Terminated: ok {rc=0} 10:18:33.714510 bus /sierra_3: Setting Powered False 10:18:34.815015 bus /sierra_3: Setting Powered False 10:18:35.935065 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 10:18:37.024215 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:18:37.035597 tst emergency:oc2g: Using 1 x bts (candidates: 1) 10:18:37.070696 tst emergency_preemptive_call.py: using LAC 33264 10:18:37.203330 tst emergency_preemptive_call.py: using RAC 114 10:18:37.333391 tst emergency_preemptive_call.py: using CellId 33264 10:18:37.461747 tst emergency_preemptive_call.py: using BVCI 33265 10:18:37.582161 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:18:37.593489 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:18:37.604591 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:18:37.615762 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:18:37.627073 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:18:37.638518 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:18:37.758198 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:18:37.881512 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:18:38.000805 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:18:38.118522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:38.601857 run create_hlr_db(pid=8001): Launched 10:18:38.729562 bus /sierra_2: Setting Powered False 10:18:39.790735 run create_hlr_db(pid=8001): Terminated: ok {rc=0} 10:18:40.246569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8003): Launched 10:18:40.583003 run osmo-hlr_10.42.42.2(pid=8004): Launched 10:18:40.709503 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:41.282497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8006): Launched 10:18:41.616833 run osmo-stp_10.42.42.5(pid=8007): Launched 10:18:41.755803 tst emergency_preemptive_call.py: using MSISDN 8108 10:18:41.932267 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:42.531105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8009): Launched 10:18:42.865345 run osmo-msc_10.42.42.6(pid=8010): Launched 10:18:43.051499 run osmo-stp_10.42.42.5(pid=8007): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8007)] 10:18:43.191195 run osmo-stp_10.42.42.5(pid=8007): stdout: | (launched: 2022-12-13_10:18:41.553922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:43.332334 run osmo-stp_10.42.42.5(pid=8007): stderr: | 20221213101841745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101841745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101841745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101841746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101841746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101841746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101841746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:43.470709 run osmo-stp_10.42.42.5(pid=8007): stdout: | (launched: 2022-12-13_10:18:41.553922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:43.603048 run osmo-stp_10.42.42.5(pid=8007): stderr: | 20221213101841745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101841745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101841745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101841746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101841746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101841746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101841746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:43.760715 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8007): Process ended prematurely: osmo-stp_10.42.42.5(pid=8007) [trial-2388↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8007)] [trial-2388↪emergency:oc2g↪emergency_preemptive_call.py:32] 10:18:43.770122 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 10:18:43.798230 run osmo-hlr_10.42.42.2(pid=8004): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8004)] 10:18:43.850721 run osmo-hlr_10.42.42.2(pid=8004): stdout: | (launched: 2022-12-13_10:18:40.519757) 10:18:43.903843 run osmo-hlr_10.42.42.2(pid=8004): stderr: | 20221213101840716 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101840716 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101840716 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101840716 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101840716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101840716 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101840729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101840739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101840739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101840739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:43.977522 run osmo-msc_10.42.42.6(pid=8010): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8010)] 10:18:44.028208 run osmo-msc_10.42.42.6(pid=8010): stdout: | (launched: 2022-12-13_10:18:42.802625) 10:18:44.081582 run osmo-msc_10.42.42.6(pid=8010): stderr: | 20221213101843122 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213101843122 DLGLOBAL DEBUG validating counter group 0x7fa1bdf81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213101843122 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213101843122 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213101843122 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213101843123 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213101843124 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213101843125 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213101843125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213101843125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:44.134566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8003): Terminating (SIGTERM) 10:18:44.177272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8006): Terminating (SIGTERM) 10:18:44.220140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8009): Terminating (SIGTERM) 10:18:44.263872 --- ParallelTerminationStrategy: PID 8003 died... 10:18:44.284706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8003): Terminated: ok {rc=0} 10:18:44.331941 --- ParallelTerminationStrategy: PID 8006 died... 10:18:44.352269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8006): Terminated: ok {rc=0} 10:18:44.399395 --- ParallelTerminationStrategy: PID 8009 died... 10:18:44.419763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8009): Terminated: ok {rc=0} 10:18:44.509825 bus /sierra_9: Setting Powered False 10:18:45.609486 bus /sierra_9: Setting Powered False 10:18:46.732420 bus /sierra_8: Setting Powered False 10:18:47.832598 bus /sierra_8: Setting Powered False 10:18:48.950379 bus /sierra_3: Setting Powered False 10:18:50.050812 bus /sierra_3: Setting Powered False 10:18:51.170345 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:oc2g --------------------------------------------------------------------- 10:18:52.435374 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:18:52.440762 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 10:18:52.461492 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 10:18:52.499905 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 10:18:52.588237 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 10:18:52.609602 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 10:18:52.649704 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 10:18:53.237261 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 10:18:53.293968 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:18:53.305451 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:18:53.341120 tst cs_paging_gprs_active.py: using LAC 33265 10:18:53.474079 tst cs_paging_gprs_active.py: using RAC 115 10:18:53.606640 tst cs_paging_gprs_active.py: using CellId 33265 10:18:53.739648 tst cs_paging_gprs_active.py: using BVCI 33266 10:18:53.864561 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:18:53.875574 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:18:53.886448 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:18:53.897355 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:18:53.908328 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:18:53.919567 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:18:53.930978 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:18:53.942290 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:18:53.953771 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:18:54.074087 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:18:54.196751 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:18:54.427482 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:18:54.770597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8015): Launched 10:18:55.069629 run iperf3-srv_10.42.42.10(pid=8016): Launched 10:18:55.197735 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:18:55.426842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:18:55.768074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8017): Launched 10:18:56.063340 run iperf3-srv_10.42.42.10(pid=8018): Launched 10:18:56.190501 tst cs_paging_gprs_active.py:38: start network... 10:18:56.419975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:56.946931 run create_hlr_db(pid=8019): Launched 10:18:57.076007 bus /sierra_2: Setting Powered False 10:18:58.142953 run create_hlr_db(pid=8019): Terminated: ok {rc=0} 10:18:58.593518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8021): Launched 10:18:58.911550 run osmo-hlr_10.42.42.2(pid=8022): Launched 10:18:59.032265 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:59.572685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8024): Launched 10:18:59.888904 run osmo-stp_10.42.42.5(pid=8025): Launched 10:19:00.008447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:00.550313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8027): Launched 10:19:00.670280 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:00.967994 run patchelf(pid=8028): Launched 10:19:01.160342 run osmo-stp_10.42.42.5(pid=8025): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8025)] 10:19:01.295760 run osmo-stp_10.42.42.5(pid=8025): stdout: | (launched: 2022-12-13_10:18:59.829278) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:01.432485 run osmo-stp_10.42.42.5(pid=8025): stderr: | 20221213101900002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101900002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101900002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101900003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101900003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101900003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101900003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:01.569318 run osmo-stp_10.42.42.5(pid=8025): stdout: | (launched: 2022-12-13_10:18:59.829278) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:01.700502 run osmo-stp_10.42.42.5(pid=8025): stderr: | 20221213101900002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101900002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101900002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101900003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101900003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101900003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101900003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:01.856586 run patchelf(pid=8028): Terminating (SIGINT) 10:19:02.037813 run patchelf(pid=8028): Terminated: ok {rc=0} 10:19:02.168403 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8025): Process ended prematurely: osmo-stp_10.42.42.5(pid=8025) [trial-2388↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8025)] [trial-2388↪gprs:oc2g↪cs_paging_gprs_active.py:38] 10:19:02.178751 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 10:19:02.207562 run osmo-hlr_10.42.42.2(pid=8022): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8022)] 10:19:02.257315 run osmo-hlr_10.42.42.2(pid=8022): stdout: | (launched: 2022-12-13_10:18:58.851804) 10:19:02.308379 run osmo-hlr_10.42.42.2(pid=8022): stderr: | 20221213101859030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101859030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101859030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101859030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101859030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101859030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101859043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101859052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101859053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101859053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:02.359728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8015): Terminating (SIGTERM) 10:19:02.400266 run iperf3-srv_10.42.42.10(pid=8016): Terminating (SIGTERM) 10:19:02.440803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8017): Terminating (SIGTERM) 10:19:02.481540 run iperf3-srv_10.42.42.10(pid=8018): Terminating (SIGTERM) 10:19:02.523391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8021): Terminating (SIGTERM) 10:19:02.564547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8024): Terminating (SIGTERM) 10:19:02.604708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8027): Terminating (SIGTERM) 10:19:02.645318 --- ParallelTerminationStrategy: PID 8015 died... 10:19:02.665117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8015): Terminated: ok {rc=0} 10:19:02.710121 --- ParallelTerminationStrategy: PID 8016 died... 10:19:02.729245 run iperf3-srv_10.42.42.10(pid=8016): Terminated {rc=256} 10:19:02.773559 --- ParallelTerminationStrategy: PID 8017 died... 10:19:02.792406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8017): Terminated: ok {rc=0} 10:19:02.836667 --- ParallelTerminationStrategy: PID 8018 died... 10:19:02.855568 run iperf3-srv_10.42.42.10(pid=8018): Terminated {rc=256} 10:19:02.899742 --- ParallelTerminationStrategy: PID 8021 died... 10:19:02.918617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8021): Terminated: ok {rc=0} 10:19:02.962901 --- ParallelTerminationStrategy: PID 8024 died... 10:19:02.981774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8024): Terminated: ok {rc=0} 10:19:03.026026 --- ParallelTerminationStrategy: PID 8027 died... 10:19:03.045145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8027): Terminated: ok {rc=0} 10:19:03.132073 bus /gobi_0: Setting Powered False 10:19:04.232674 bus /gobi_0: Setting Powered False 10:19:05.347165 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g iperf3.py ---------------------------------------------- 10:19:06.497797 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:06.509581 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:19:06.545866 tst iperf3.py: using LAC 33266 10:19:06.680294 tst iperf3.py: using RAC 116 10:19:06.813282 tst iperf3.py: using CellId 33266 10:19:06.937418 tst iperf3.py: using BVCI 33267 10:19:07.053522 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:07.064142 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:07.074832 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:07.085557 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:07.096121 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:07.107261 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:07.118151 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:07.128732 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:07.139599 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:19:07.259234 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:19:07.490663 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:07.832769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8029): Launched 10:19:08.127968 run iperf3-srv_10.42.42.10(pid=8030): Launched 10:19:08.255654 tst iperf3.py:8: start network... 10:19:08.483930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:09.009412 run create_hlr_db(pid=8031): Launched 10:19:09.139807 bus /gobi_6: Setting Powered False 10:19:10.206870 run create_hlr_db(pid=8031): Terminated: ok {rc=0} 10:19:10.677670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8033): Launched 10:19:11.019118 run osmo-hlr_10.42.42.2(pid=8034): Launched 10:19:11.149454 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:11.734192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8036): Launched 10:19:12.075097 run osmo-stp_10.42.42.5(pid=8037): Launched 10:19:12.204137 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:12.789638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8039): Launched 10:19:12.919734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:13.206510 run patchelf(pid=8040): Launched 10:19:13.395590 run osmo-stp_10.42.42.5(pid=8037): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8037)] 10:19:13.537944 run osmo-stp_10.42.42.5(pid=8037): stdout: | (launched: 2022-12-13_10:19:12.011213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:13.681597 run osmo-stp_10.42.42.5(pid=8037): stderr: | 20221213101912203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101912204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101912204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101912204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101912205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101912205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101912205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:13.825270 run osmo-stp_10.42.42.5(pid=8037): stdout: | (launched: 2022-12-13_10:19:12.011213) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:13.963407 run osmo-stp_10.42.42.5(pid=8037): stderr: | 20221213101912203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101912204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101912204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101912204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101912205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101912205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101912205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:14.127097 run patchelf(pid=8040): Terminating (SIGINT) 10:19:14.316869 run patchelf(pid=8040): Terminated: ok {rc=0} 10:19:14.453400 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8037): Process ended prematurely: osmo-stp_10.42.42.5(pid=8037) [trial-2388↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8037)] [trial-2388↪gprs:oc2g↪iperf3.py:8] 10:19:14.463705 tst iperf3.py:8: Test FAILED (8.0 sec) 10:19:14.492567 run osmo-hlr_10.42.42.2(pid=8034): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8034)] 10:19:14.543752 run osmo-hlr_10.42.42.2(pid=8034): stdout: | (launched: 2022-12-13_10:19:10.954957) 10:19:14.596329 run osmo-hlr_10.42.42.2(pid=8034): stderr: | 20221213101911151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101911151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101911151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101911151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101911151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101911151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101911164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101911173 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101911173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101911173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:14.649779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8029): Terminating (SIGTERM) 10:19:14.691853 run iperf3-srv_10.42.42.10(pid=8030): Terminating (SIGTERM) 10:19:14.734889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8033): Terminating (SIGTERM) 10:19:14.777692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8036): Terminating (SIGTERM) 10:19:14.820290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8039): Terminating (SIGTERM) 10:19:14.863759 --- ParallelTerminationStrategy: PID 8029 died... 10:19:14.884139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8029): Terminated: ok {rc=0} 10:19:14.931285 --- ParallelTerminationStrategy: PID 8030 died... 10:19:14.951283 run iperf3-srv_10.42.42.10(pid=8030): Terminated {rc=256} 10:19:14.997768 --- ParallelTerminationStrategy: PID 8033 died... 10:19:15.017918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8033): Terminated: ok {rc=0} 10:19:15.064393 --- ParallelTerminationStrategy: PID 8036 died... 10:19:15.084520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8036): Terminated: ok {rc=0} 10:19:15.131381 --- ParallelTerminationStrategy: PID 8039 died... 10:19:15.151447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8039): Terminated: ok {rc=0} 10:19:15.241320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g iperf3m4.py ---------------------------------------------- 10:19:16.411822 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:16.424290 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:19:16.461299 tst iperf3m4.py: using LAC 33267 10:19:16.590716 tst iperf3m4.py: using RAC 117 10:19:16.756298 tst iperf3m4.py: using CellId 33267 10:19:16.887497 tst iperf3m4.py: using BVCI 33268 10:19:17.034385 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:17.046392 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:17.058382 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:17.070460 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:17.083367 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:17.096299 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:17.109495 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:17.122445 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:17.135558 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:19:17.267034 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:19:17.395588 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:19:17.514303 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:19:17.635869 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:19:17.864555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:18.207202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8041): Launched 10:19:18.505670 run iperf3-srv_10.42.42.10(pid=8042): Launched 10:19:18.633835 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:19:18.862106 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:19.202751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8043): Launched 10:19:19.500489 run iperf3-srv_10.42.42.10(pid=8044): Launched 10:19:19.627309 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:19:19.854993 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:20.196345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8045): Launched 10:19:20.494108 run iperf3-srv_10.42.42.10(pid=8046): Launched 10:19:20.621719 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:19:20.849514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:21.190347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8047): Launched 10:19:21.488104 run iperf3-srv_10.42.42.10(pid=8048): Launched 10:19:21.614248 tst iperf3m4.py:8: start network... 10:19:21.841797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:22.371179 run create_hlr_db(pid=8049): Launched 10:19:22.500061 bus /gobi_6: Setting Powered False 10:19:23.566082 run create_hlr_db(pid=8049): Terminated: ok {rc=0} 10:19:24.016328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8052): Launched 10:19:24.335434 run osmo-hlr_10.42.42.2(pid=8053): Launched 10:19:24.456250 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:24.999408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8055): Launched 10:19:25.317380 run osmo-stp_10.42.42.5(pid=8056): Launched 10:19:25.436864 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:25.981505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8058): Launched 10:19:26.103027 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:26.371093 run patchelf(pid=8059): Launched 10:19:26.545687 run osmo-stp_10.42.42.5(pid=8056): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8056)] 10:19:26.678842 run osmo-stp_10.42.42.5(pid=8056): stdout: | (launched: 2022-12-13_10:19:25.256922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:26.812912 run osmo-stp_10.42.42.5(pid=8056): stderr: | 20221213101925430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101925431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101925431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101925431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101925432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101925432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101925432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:26.948045 run osmo-stp_10.42.42.5(pid=8056): stdout: | (launched: 2022-12-13_10:19:25.256922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:27.076721 run osmo-stp_10.42.42.5(pid=8056): stderr: | 20221213101925430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101925431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101925431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101925431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101925432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101925432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101925432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:27.229604 run patchelf(pid=8059): Terminating (SIGINT) 10:19:27.406942 run patchelf(pid=8059): Terminated: ok {rc=0} 10:19:27.534430 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8056): Process ended prematurely: osmo-stp_10.42.42.5(pid=8056) [trial-2388↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8056)] [trial-2388↪gprs:oc2g↪iperf3m4.py:8] 10:19:27.543927 tst iperf3m4.py:8: Test FAILED (11.2 sec) 10:19:27.571679 run osmo-hlr_10.42.42.2(pid=8053): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8053)] 10:19:27.620262 run osmo-hlr_10.42.42.2(pid=8053): stdout: | (launched: 2022-12-13_10:19:24.275185) 10:19:27.670078 run osmo-hlr_10.42.42.2(pid=8053): stderr: | 20221213101924454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101924454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101924454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101924454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101924455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101924455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101924467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101924475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101924475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101924475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:27.720300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8041): Terminating (SIGTERM) 10:19:27.760718 run iperf3-srv_10.42.42.10(pid=8042): Terminating (SIGTERM) 10:19:27.801099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8043): Terminating (SIGTERM) 10:19:27.841608 run iperf3-srv_10.42.42.10(pid=8044): Terminating (SIGTERM) 10:19:27.881873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8045): Terminating (SIGTERM) 10:19:27.922786 run iperf3-srv_10.42.42.10(pid=8046): Terminating (SIGTERM) 10:19:27.963002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8047): Terminating (SIGTERM) 10:19:28.003211 run iperf3-srv_10.42.42.10(pid=8048): Terminating (SIGTERM) 10:19:28.043381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8052): Terminating (SIGTERM) 10:19:28.083654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8055): Terminating (SIGTERM) 10:19:28.123974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8058): Terminating (SIGTERM) 10:19:28.164665 --- ParallelTerminationStrategy: PID 8041 died... 10:19:28.184177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8041): Terminated: ok {rc=0} 10:19:28.229256 --- ParallelTerminationStrategy: PID 8042 died... 10:19:28.248071 run iperf3-srv_10.42.42.10(pid=8042): Terminated {rc=256} 10:19:28.292330 --- ParallelTerminationStrategy: PID 8043 died... 10:19:28.311226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8043): Terminated: ok {rc=0} 10:19:28.355312 --- ParallelTerminationStrategy: PID 8044 died... 10:19:28.374168 run iperf3-srv_10.42.42.10(pid=8044): Terminated {rc=256} 10:19:28.418304 --- ParallelTerminationStrategy: PID 8045 died... 10:19:28.437253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8045): Terminated: ok {rc=0} 10:19:28.481543 --- ParallelTerminationStrategy: PID 8046 died... 10:19:28.500377 run iperf3-srv_10.42.42.10(pid=8046): Terminated {rc=256} 10:19:28.544568 --- ParallelTerminationStrategy: PID 8047 died... 10:19:28.563515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8047): Terminated: ok {rc=0} 10:19:28.607878 --- ParallelTerminationStrategy: PID 8048 died... 10:19:28.626839 run iperf3-srv_10.42.42.10(pid=8048): Terminated {rc=256} 10:19:28.670981 --- ParallelTerminationStrategy: PID 8052 died... 10:19:28.690067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8052): Terminated: ok {rc=0} 10:19:28.734263 --- ParallelTerminationStrategy: PID 8055 died... 10:19:28.753333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8055): Terminated: ok {rc=0} 10:19:28.797700 --- ParallelTerminationStrategy: PID 8058 died... 10:19:28.816807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8058): Terminated: ok {rc=0} 10:19:28.903560 bus /gobi_4: Setting Powered False 10:19:30.005320 bus /gobi_4: Setting Powered False 10:19:31.119485 bus /gobi_1: Setting Powered False 10:19:32.231250 bus /gobi_1: Setting Powered False 10:19:33.348351 bus /gobi_0: Setting Powered False 10:19:34.448380 bus /gobi_0: Setting Powered False 10:19:35.562215 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g ping.py ---------------------------------------------- 10:19:36.666961 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:36.679010 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:19:36.715676 tst ping.py: using LAC 33268 10:19:36.837045 tst ping.py: using RAC 118 10:19:36.958475 tst ping.py: using CellId 33268 10:19:37.080484 tst ping.py: using BVCI 33269 10:19:37.193888 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:37.204661 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:37.215302 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:37.225742 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:37.236065 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:37.246988 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:37.258006 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:37.268904 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:19:37.388857 tst ping.py:19: start network... 10:19:37.596508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:38.076013 run create_hlr_db(pid=8060): Launched 10:19:38.202527 bus /gobi_6: Setting Powered False 10:19:39.263405 run create_hlr_db(pid=8060): Terminated: ok {rc=0} 10:19:39.717456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8062): Launched 10:19:40.052920 run osmo-hlr_10.42.42.2(pid=8063): Launched 10:19:40.180827 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:40.760535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8065): Launched 10:19:41.097386 run osmo-stp_10.42.42.5(pid=8066): Launched 10:19:41.226179 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:41.801680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8068): Launched 10:19:41.930613 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:42.213442 run patchelf(pid=8069): Launched 10:19:42.397933 run osmo-stp_10.42.42.5(pid=8066): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8066)] 10:19:42.537971 run osmo-stp_10.42.42.5(pid=8066): stdout: | (launched: 2022-12-13_10:19:41.034035) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:42.679675 run osmo-stp_10.42.42.5(pid=8066): stderr: | 20221213101941226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101941226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101941227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101941227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101941227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101941228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101941228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:42.821224 run osmo-stp_10.42.42.5(pid=8066): stdout: | (launched: 2022-12-13_10:19:41.034035) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:42.956873 run osmo-stp_10.42.42.5(pid=8066): stderr: | 20221213101941226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101941226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101941227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101941227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101941227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101941228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101941228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:43.118591 run patchelf(pid=8069): Terminating (SIGINT) 10:19:43.305207 run patchelf(pid=8069): Terminated: ok {rc=0} 10:19:43.439532 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8066): Process ended prematurely: osmo-stp_10.42.42.5(pid=8066) [trial-2388↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8066)] [trial-2388↪gprs:oc2g↪ping.py:22] 10:19:43.449366 tst ping.py:22: Test FAILED (6.8 sec) 10:19:43.478060 run osmo-hlr_10.42.42.2(pid=8063): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8063)] 10:19:43.529872 run osmo-hlr_10.42.42.2(pid=8063): stdout: | (launched: 2022-12-13_10:19:39.989976) 10:19:43.583254 run osmo-hlr_10.42.42.2(pid=8063): stderr: | 20221213101940188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101940188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101940188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101940188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101940188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101940188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101940200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101940210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101940210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101940210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:43.636921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8062): Terminating (SIGTERM) 10:19:43.679877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8065): Terminating (SIGTERM) 10:19:43.723072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8068): Terminating (SIGTERM) 10:19:43.766618 --- ParallelTerminationStrategy: PID 8062 died... 10:19:43.787755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8062): Terminated: ok {rc=0} 10:19:43.835246 --- ParallelTerminationStrategy: PID 8065 died... 10:19:43.855757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8065): Terminated: ok {rc=0} 10:19:43.903228 --- ParallelTerminationStrategy: PID 8068 died... 10:19:43.923728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8068): Terminated: ok {rc=0} 10:19:44.014298 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 10:19:45.102651 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:45.114711 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:19:45.151693 tst ping_idle_ping.py: using LAC 33269 10:19:45.275090 tst ping_idle_ping.py: using RAC 119 10:19:45.396802 tst ping_idle_ping.py: using CellId 33269 10:19:45.519717 tst ping_idle_ping.py: using BVCI 33270 10:19:45.633750 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:45.644275 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:45.654885 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:45.665359 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:45.675964 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:45.686964 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:45.697882 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:19:45.708764 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:19:45.825054 tst ping_idle_ping.py:24: start network... 10:19:46.050569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:46.543426 run create_hlr_db(pid=8070): Launched 10:19:46.695732 bus /gobi_6: Setting Powered False 10:19:47.758093 run create_hlr_db(pid=8070): Terminated: ok {rc=0} 10:19:48.214237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8072): Launched 10:19:48.552400 run osmo-hlr_10.42.42.2(pid=8073): Launched 10:19:48.681370 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:49.261703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8075): Launched 10:19:49.598952 run osmo-stp_10.42.42.5(pid=8076): Launched 10:19:49.725100 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:50.301555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8078): Launched 10:19:50.430017 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:50.713601 run patchelf(pid=8079): Launched 10:19:50.899234 run osmo-stp_10.42.42.5(pid=8076): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8076)] 10:19:51.039751 run osmo-stp_10.42.42.5(pid=8076): stdout: | (launched: 2022-12-13_10:19:49.535603) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:51.182009 run osmo-stp_10.42.42.5(pid=8076): stderr: | 20221213101949726 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101949726 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101949727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101949727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101949728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101949728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101949728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:51.324280 run osmo-stp_10.42.42.5(pid=8076): stdout: | (launched: 2022-12-13_10:19:49.535603) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:51.460714 run osmo-stp_10.42.42.5(pid=8076): stderr: | 20221213101949726 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213101949726 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213101949727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213101949727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213101949728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213101949728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213101949728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:51.622586 run patchelf(pid=8079): Terminating (SIGINT) 10:19:51.809465 run patchelf(pid=8079): Terminated: ok {rc=0} 10:19:51.943986 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8076): Process ended prematurely: osmo-stp_10.42.42.5(pid=8076) [trial-2388↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8076)] [trial-2388↪gprs:oc2g↪ping_idle_ping.py:27] 10:19:51.954041 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:19:51.982867 run osmo-hlr_10.42.42.2(pid=8073): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8073)] 10:19:52.034300 run osmo-hlr_10.42.42.2(pid=8073): stdout: | (launched: 2022-12-13_10:19:48.489169) 10:19:52.088077 run osmo-hlr_10.42.42.2(pid=8073): stderr: | 20221213101948687 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213101948687 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213101948687 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213101948687 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213101948687 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213101948687 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213101948702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213101948710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213101948710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213101948710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:52.140899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8072): Terminating (SIGTERM) 10:19:52.183335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8075): Terminating (SIGTERM) 10:19:52.226079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8078): Terminating (SIGTERM) 10:19:52.269181 --- ParallelTerminationStrategy: PID 8072 died... 10:19:52.290605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8072): Terminated: ok {rc=0} 10:19:52.338301 --- ParallelTerminationStrategy: PID 8075 died... 10:19:52.358860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8075): Terminated: ok {rc=0} 10:19:52.406309 --- ParallelTerminationStrategy: PID 8078 died... 10:19:52.426916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8078): Terminated: ok {rc=0} 10:19:52.516792 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 10:19:53.812308 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:19:53.818076 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:19:53.839083 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:19:53.879041 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:19:53.967665 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:19:53.988640 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:19:54.027943 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:19:54.622405 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:19:54.675782 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:19:54.686892 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:19:54.724148 tst cs_paging_gprs_active.py: using LAC 33270 10:19:54.855023 tst cs_paging_gprs_active.py: using RAC 120 10:19:54.985624 tst cs_paging_gprs_active.py: using CellId 33270 10:19:55.107970 tst cs_paging_gprs_active.py: using BVCI 33271 10:19:55.230185 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:19:55.241623 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:19:55.253137 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:19:55.264208 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:19:55.275701 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:19:55.287454 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:19:55.299063 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:19:55.310614 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:19:55.322256 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:19:55.442813 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:19:55.563845 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:19:55.788803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:56.123969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8083): Launched 10:19:56.415283 run iperf3-srv_10.42.42.10(pid=8084): Launched 10:19:56.539184 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:19:56.762115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:57.094961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8085): Launched 10:19:57.386633 run iperf3-srv_10.42.42.10(pid=8086): Launched 10:19:57.511206 tst cs_paging_gprs_active.py:38: start network... 10:19:57.734297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:58.250707 run create_hlr_db(pid=8087): Launched 10:19:58.379252 bus /gobi_6: Setting Powered False 10:19:59.445206 run create_hlr_db(pid=8087): Terminated: ok {rc=0} 10:19:59.887816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8089): Launched 10:20:00.201856 run osmo-hlr_10.42.42.2(pid=8090): Launched 10:20:00.331020 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:00.915738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8092): Launched 10:20:01.290720 run osmo-stp_10.42.42.5(pid=8093): Launched 10:20:01.477213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:02.160733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8098): Launched 10:20:02.305766 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:02.569997 run patchelf(pid=8099): Launched 10:20:02.744103 run osmo-stp_10.42.42.5(pid=8093): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8093)] 10:20:02.874327 run osmo-stp_10.42.42.5(pid=8093): stdout: | (launched: 2022-12-13_10:20:01.227435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:03.005868 run osmo-stp_10.42.42.5(pid=8093): stderr: | 20221213102001604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102001604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102001607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102001610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102001611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102001611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102001611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:03.137423 run osmo-stp_10.42.42.5(pid=8093): stdout: | (launched: 2022-12-13_10:20:01.227435) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:03.264244 run osmo-stp_10.42.42.5(pid=8093): stderr: | 20221213102001604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102001604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102001607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102001610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102001611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102001611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102001611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:03.413734 run patchelf(pid=8099): Terminating (SIGINT) 10:20:03.586958 run patchelf(pid=8099): Terminated: ok {rc=0} 10:20:03.711622 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8093): Process ended prematurely: osmo-stp_10.42.42.5(pid=8093) [trial-2388↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8093)] [trial-2388↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:20:03.721306 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 10:20:03.748342 run osmo-hlr_10.42.42.2(pid=8090): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8090)] 10:20:03.796879 run osmo-hlr_10.42.42.2(pid=8090): stdout: | (launched: 2022-12-13_10:20:00.141134) 10:20:03.846849 run osmo-hlr_10.42.42.2(pid=8090): stderr: | 20221213102000338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102000338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102000338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102000338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102000338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102000338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102000350 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102000360 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102000361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102000361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:03.897201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8083): Terminating (SIGTERM) 10:20:03.937424 run iperf3-srv_10.42.42.10(pid=8084): Terminating (SIGTERM) 10:20:03.977577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8085): Terminating (SIGTERM) 10:20:04.018149 run iperf3-srv_10.42.42.10(pid=8086): Terminating (SIGTERM) 10:20:04.058328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8089): Terminating (SIGTERM) 10:20:04.098757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8092): Terminating (SIGTERM) 10:20:04.139080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8098): Terminating (SIGTERM) 10:20:04.179683 --- ParallelTerminationStrategy: PID 8083 died... 10:20:04.199186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8083): Terminated: ok {rc=0} 10:20:04.243736 --- ParallelTerminationStrategy: PID 8084 died... 10:20:04.262492 run iperf3-srv_10.42.42.10(pid=8084): Terminated {rc=256} 10:20:04.306711 --- ParallelTerminationStrategy: PID 8085 died... 10:20:04.325466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8085): Terminated: ok {rc=0} 10:20:04.369637 --- ParallelTerminationStrategy: PID 8086 died... 10:20:04.388389 run iperf3-srv_10.42.42.10(pid=8086): Terminated {rc=256} 10:20:04.432439 --- ParallelTerminationStrategy: PID 8089 died... 10:20:04.451250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8089): Terminated: ok {rc=0} 10:20:04.495443 --- ParallelTerminationStrategy: PID 8092 died... 10:20:04.514289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8092): Terminated: ok {rc=0} 10:20:04.558462 --- ParallelTerminationStrategy: PID 8098 died... 10:20:04.577469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8098): Terminated: ok {rc=0} 10:20:04.664300 bus /gobi_0: Setting Powered False 10:20:05.765321 bus /gobi_0: Setting Powered False 10:20:06.880131 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:20:08.029509 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:08.041046 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:20:08.078323 tst iperf3.py: using LAC 33271 10:20:08.199766 tst iperf3.py: using RAC 121 10:20:08.325677 tst iperf3.py: using CellId 33271 10:20:08.447256 tst iperf3.py: using BVCI 33272 10:20:08.561148 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:08.571766 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:08.582531 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:08.593176 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:08.603563 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:08.614761 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:08.625699 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:08.636304 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:08.647108 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:08.771152 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:20:08.994540 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:09.330445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8100): Launched 10:20:09.621534 run iperf3-srv_10.42.42.10(pid=8101): Launched 10:20:09.745444 tst iperf3.py:8: start network... 10:20:09.968285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:10.482752 run create_hlr_db(pid=8102): Launched 10:20:10.610526 bus /gobi_6: Setting Powered False 10:20:11.676039 run create_hlr_db(pid=8102): Terminated: ok {rc=0} 10:20:12.137231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8104): Launched 10:20:12.470148 run osmo-hlr_10.42.42.2(pid=8105): Launched 10:20:12.595570 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:13.163510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8107): Launched 10:20:13.496457 run osmo-stp_10.42.42.5(pid=8108): Launched 10:20:13.624055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:14.195453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8110): Launched 10:20:14.322063 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:14.603463 run patchelf(pid=8111): Launched 10:20:14.786777 run osmo-stp_10.42.42.5(pid=8108): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8108)] 10:20:14.926936 run osmo-stp_10.42.42.5(pid=8108): stdout: | (launched: 2022-12-13_10:20:13.434195) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:15.068158 run osmo-stp_10.42.42.5(pid=8108): stderr: | 20221213102013627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102013627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102013628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102013628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102013629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102013629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102013629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:15.209260 run osmo-stp_10.42.42.5(pid=8108): stdout: | (launched: 2022-12-13_10:20:13.434195) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:15.345719 run osmo-stp_10.42.42.5(pid=8108): stderr: | 20221213102013627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102013627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102013628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102013628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102013629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102013629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102013629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:15.506664 run patchelf(pid=8111): Terminating (SIGINT) 10:20:15.691993 run patchelf(pid=8111): Terminated: ok {rc=0} 10:20:15.825781 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8108): Process ended prematurely: osmo-stp_10.42.42.5(pid=8108) [trial-2388↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8108)] [trial-2388↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 10:20:15.836177 tst iperf3.py:8: Test FAILED (7.8 sec) 10:20:15.871985 run osmo-hlr_10.42.42.2(pid=8105): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8105)] 10:20:15.926025 run osmo-hlr_10.42.42.2(pid=8105): stdout: | (launched: 2022-12-13_10:20:12.407746) 10:20:15.981889 run osmo-hlr_10.42.42.2(pid=8105): stderr: | 20221213102012606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102012606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102012606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102012606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102012607 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102012607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102012620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102012630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102012630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102012630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:16.040890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8100): Terminating (SIGTERM) 10:20:16.084163 run iperf3-srv_10.42.42.10(pid=8101): Terminating (SIGTERM) 10:20:16.129163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8104): Terminating (SIGTERM) 10:20:16.171807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8107): Terminating (SIGTERM) 10:20:16.216525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8110): Terminating (SIGTERM) 10:20:16.261208 --- ParallelTerminationStrategy: PID 8100 died... 10:20:16.281761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8100): Terminated: ok {rc=0} 10:20:16.328752 --- ParallelTerminationStrategy: PID 8101 died... 10:20:16.348345 run iperf3-srv_10.42.42.10(pid=8101): Terminated {rc=256} 10:20:16.395226 --- ParallelTerminationStrategy: PID 8104 died... 10:20:16.414798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8104): Terminated: ok {rc=0} 10:20:16.460196 --- ParallelTerminationStrategy: PID 8107 died... 10:20:16.479823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8107): Terminated: ok {rc=0} 10:20:16.525513 --- ParallelTerminationStrategy: PID 8110 died... 10:20:16.544846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8110): Terminated: ok {rc=0} 10:20:16.641566 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:20:17.809992 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:17.822040 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:20:17.860442 tst iperf3m4.py: using LAC 33272 10:20:17.984391 tst iperf3m4.py: using RAC 122 10:20:18.115237 tst iperf3m4.py: using CellId 33272 10:20:18.245796 tst iperf3m4.py: using BVCI 33273 10:20:18.366337 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:18.377624 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:18.388895 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:18.400221 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:18.411560 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:18.422956 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:18.434528 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:18.445813 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:18.457382 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:18.578464 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:18.701898 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:18.821342 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:18.942596 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:20:19.165570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:19.501678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8112): Launched 10:20:19.791938 run iperf3-srv_10.42.42.10(pid=8113): Launched 10:20:19.917611 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:20:20.140461 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:20.475447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8114): Launched 10:20:20.765675 run iperf3-srv_10.42.42.10(pid=8115): Launched 10:20:20.882422 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:20:21.088394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:21.401815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8116): Launched 10:20:21.672188 run iperf3-srv_10.42.42.10(pid=8117): Launched 10:20:21.788907 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:20:21.994374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:22.306151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8118): Launched 10:20:22.576459 run iperf3-srv_10.42.42.10(pid=8119): Launched 10:20:22.693397 tst iperf3m4.py:8: start network... 10:20:22.900254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:23.382846 run create_hlr_db(pid=8120): Launched 10:20:23.507922 bus /gobi_6: Setting Powered False 10:20:24.569539 run create_hlr_db(pid=8120): Terminated: ok {rc=0} 10:20:25.001884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8122): Launched 10:20:25.312349 run osmo-hlr_10.42.42.2(pid=8123): Launched 10:20:25.431165 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:25.973637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8125): Launched 10:20:26.284243 run osmo-stp_10.42.42.5(pid=8126): Launched 10:20:26.403128 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:26.938702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8128): Launched 10:20:27.059482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:27.322571 run patchelf(pid=8129): Launched 10:20:27.496009 run osmo-stp_10.42.42.5(pid=8126): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8126)] 10:20:27.626635 run osmo-stp_10.42.42.5(pid=8126): stdout: | (launched: 2022-12-13_10:20:26.225317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:27.758213 run osmo-stp_10.42.42.5(pid=8126): stderr: | 20221213102026398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102026398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102026398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102026399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102026399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102026399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102026399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:27.890324 run osmo-stp_10.42.42.5(pid=8126): stdout: | (launched: 2022-12-13_10:20:26.225317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:28.016870 run osmo-stp_10.42.42.5(pid=8126): stderr: | 20221213102026398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102026398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102026398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102026399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102026399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102026399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102026399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:28.166406 run patchelf(pid=8129): Terminating (SIGINT) 10:20:28.339818 run patchelf(pid=8129): Terminated: ok {rc=0} 10:20:28.464927 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8126): Process ended prematurely: osmo-stp_10.42.42.5(pid=8126) [trial-2388↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8126)] [trial-2388↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 10:20:28.474621 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:20:28.501980 run osmo-hlr_10.42.42.2(pid=8123): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8123)] 10:20:28.549979 run osmo-hlr_10.42.42.2(pid=8123): stdout: | (launched: 2022-12-13_10:20:25.253347) 10:20:28.599625 run osmo-hlr_10.42.42.2(pid=8123): stderr: | 20221213102025432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102025432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102025432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102025432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102025432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102025432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102025444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102025453 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102025453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102025453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:28.649823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8112): Terminating (SIGTERM) 10:20:28.689961 run iperf3-srv_10.42.42.10(pid=8113): Terminating (SIGTERM) 10:20:28.731258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8114): Terminating (SIGTERM) 10:20:28.771758 run iperf3-srv_10.42.42.10(pid=8115): Terminating (SIGTERM) 10:20:28.811827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8116): Terminating (SIGTERM) 10:20:28.851878 run iperf3-srv_10.42.42.10(pid=8117): Terminating (SIGTERM) 10:20:28.891501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8118): Terminating (SIGTERM) 10:20:28.931405 run iperf3-srv_10.42.42.10(pid=8119): Terminating (SIGTERM) 10:20:28.971071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8122): Terminating (SIGTERM) 10:20:29.010966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8125): Terminating (SIGTERM) 10:20:29.050852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8128): Terminating (SIGTERM) 10:20:29.091100 --- ParallelTerminationStrategy: PID 8112 died... 10:20:29.110365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8112): Terminated: ok {rc=0} 10:20:29.154919 --- ParallelTerminationStrategy: PID 8113 died... 10:20:29.173762 run iperf3-srv_10.42.42.10(pid=8113): Terminated {rc=256} 10:20:29.217911 --- ParallelTerminationStrategy: PID 8114 died... 10:20:29.236713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8114): Terminated: ok {rc=0} 10:20:29.280998 --- ParallelTerminationStrategy: PID 8115 died... 10:20:29.299714 run iperf3-srv_10.42.42.10(pid=8115): Terminated {rc=256} 10:20:29.343731 --- ParallelTerminationStrategy: PID 8116 died... 10:20:29.362586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8116): Terminated: ok {rc=0} 10:20:29.407210 --- ParallelTerminationStrategy: PID 8117 died... 10:20:29.426113 run iperf3-srv_10.42.42.10(pid=8117): Terminated {rc=256} 10:20:29.470164 --- ParallelTerminationStrategy: PID 8118 died... 10:20:29.488902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8118): Terminated: ok {rc=0} 10:20:29.533280 --- ParallelTerminationStrategy: PID 8119 died... 10:20:29.552046 run iperf3-srv_10.42.42.10(pid=8119): Terminated {rc=256} 10:20:29.596270 --- ParallelTerminationStrategy: PID 8122 died... 10:20:29.615008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8122): Terminated: ok {rc=0} 10:20:29.658999 --- ParallelTerminationStrategy: PID 8125 died... 10:20:29.677745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8125): Terminated: ok {rc=0} 10:20:29.721925 --- ParallelTerminationStrategy: PID 8128 died... 10:20:29.740681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8128): Terminated: ok {rc=0} 10:20:29.825074 bus /gobi_4: Setting Powered False 10:20:30.938319 bus /gobi_4: Setting Powered False 10:20:32.057265 bus /gobi_1: Setting Powered False 10:20:33.156449 bus /gobi_1: Setting Powered False 10:20:34.271773 bus /gobi_0: Setting Powered False 10:20:35.372267 bus /gobi_0: Setting Powered False 10:20:36.488847 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 10:20:37.593864 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:37.605249 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:20:37.641357 tst ping.py: using LAC 33273 10:20:37.770320 tst ping.py: using RAC 123 10:20:37.903093 tst ping.py: using CellId 33273 10:20:38.030550 tst ping.py: using BVCI 33274 10:20:38.148287 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:38.159775 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:38.171243 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:38.182627 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:38.194095 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:38.205481 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:38.217054 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:38.228601 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:38.346337 tst ping.py:19: start network... 10:20:38.548165 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:39.018181 run create_hlr_db(pid=8130): Launched 10:20:39.143766 bus /gobi_6: Setting Powered False 10:20:40.205138 run create_hlr_db(pid=8130): Terminated: ok {rc=0} 10:20:40.651140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8132): Launched 10:20:40.979469 run osmo-hlr_10.42.42.2(pid=8133): Launched 10:20:41.105439 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:41.672891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8135): Launched 10:20:42.002671 run osmo-stp_10.42.42.5(pid=8136): Launched 10:20:42.126381 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:42.689880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8138): Launched 10:20:42.814375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:43.091575 run patchelf(pid=8139): Launched 10:20:43.273724 run osmo-stp_10.42.42.5(pid=8136): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8136)] 10:20:43.412352 run osmo-stp_10.42.42.5(pid=8136): stdout: | (launched: 2022-12-13_10:20:41.940507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:43.551779 run osmo-stp_10.42.42.5(pid=8136): stderr: | 20221213102042130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102042131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102042131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102042131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102042132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102042132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102042132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:43.691666 run osmo-stp_10.42.42.5(pid=8136): stdout: | (launched: 2022-12-13_10:20:41.940507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:43.825399 run osmo-stp_10.42.42.5(pid=8136): stderr: | 20221213102042130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102042131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102042131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102042131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102042132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102042132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102042132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:43.984033 run patchelf(pid=8139): Terminating (SIGINT) 10:20:44.167386 run patchelf(pid=8139): Terminated: ok {rc=0} 10:20:44.299563 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8136): Process ended prematurely: osmo-stp_10.42.42.5(pid=8136) [trial-2388↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8136)] [trial-2388↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 10:20:44.309749 tst ping.py:22: Test FAILED (6.7 sec) 10:20:44.338089 run osmo-hlr_10.42.42.2(pid=8133): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8133)] 10:20:44.389385 run osmo-hlr_10.42.42.2(pid=8133): stdout: | (launched: 2022-12-13_10:20:40.917861) 10:20:44.442410 run osmo-hlr_10.42.42.2(pid=8133): stderr: | 20221213102041113 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102041113 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102041113 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102041114 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102041114 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102041114 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102041126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102041137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102041137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102041137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:44.495604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8132): Terminating (SIGTERM) 10:20:44.537980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8135): Terminating (SIGTERM) 10:20:44.581064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8138): Terminating (SIGTERM) 10:20:44.624096 --- ParallelTerminationStrategy: PID 8132 died... 10:20:44.645050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8132): Terminated: ok {rc=0} 10:20:44.692228 --- ParallelTerminationStrategy: PID 8135 died... 10:20:44.712381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8135): Terminated: ok {rc=0} 10:20:44.759895 --- ParallelTerminationStrategy: PID 8138 died... 10:20:44.780204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8138): Terminated: ok {rc=0} 10:20:44.870697 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:20:45.967302 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:45.985711 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:20:46.028632 tst ping_idle_ping.py: using LAC 33274 10:20:46.149603 tst ping_idle_ping.py: using RAC 124 10:20:46.316195 tst ping_idle_ping.py: using CellId 33274 10:20:46.448091 tst ping_idle_ping.py: using BVCI 33275 10:20:46.608464 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:46.621959 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:46.637266 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:46.653543 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:46.667423 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:46.680420 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:46.692609 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:46.705848 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:46.825541 tst ping_idle_ping.py:24: start network... 10:20:47.038007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:47.527306 run create_hlr_db(pid=8140): Launched 10:20:47.655800 bus /gobi_6: Setting Powered False 10:20:48.717406 run create_hlr_db(pid=8140): Terminated: ok {rc=0} 10:20:49.147171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8142): Launched 10:20:49.457552 run osmo-hlr_10.42.42.2(pid=8143): Launched 10:20:49.575127 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:50.101634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8145): Launched 10:20:50.408816 run osmo-stp_10.42.42.5(pid=8146): Launched 10:20:50.525671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:51.052648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8148): Launched 10:20:51.171454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:51.431573 run patchelf(pid=8149): Launched 10:20:51.603703 run osmo-stp_10.42.42.5(pid=8146): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8146)] 10:20:51.733458 run osmo-stp_10.42.42.5(pid=8146): stdout: | (launched: 2022-12-13_10:20:50.350489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:51.871401 run osmo-stp_10.42.42.5(pid=8146): stderr: | 20221213102050521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102050521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102050522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102050522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102050523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102050523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102050523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:52.012124 run osmo-stp_10.42.42.5(pid=8146): stdout: | (launched: 2022-12-13_10:20:50.350489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:52.146892 run osmo-stp_10.42.42.5(pid=8146): stderr: | 20221213102050521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102050521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102050522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102050522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102050523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102050523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102050523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:52.305735 run patchelf(pid=8149): Terminating (SIGINT) 10:20:52.489941 run patchelf(pid=8149): Terminated: ok {rc=0} 10:20:52.622846 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8146): Process ended prematurely: osmo-stp_10.42.42.5(pid=8146) [trial-2388↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8146)] [trial-2388↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 10:20:52.632542 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:20:52.661009 run osmo-hlr_10.42.42.2(pid=8143): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8143)] 10:20:52.712611 run osmo-hlr_10.42.42.2(pid=8143): stdout: | (launched: 2022-12-13_10:20:49.398908) 10:20:52.765841 run osmo-hlr_10.42.42.2(pid=8143): stderr: | 20221213102049577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102049577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102049577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102049577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102049577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102049577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102049592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102049602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102049602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102049602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:52.819600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8142): Terminating (SIGTERM) 10:20:52.862431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8145): Terminating (SIGTERM) 10:20:52.905435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8148): Terminating (SIGTERM) 10:20:52.948748 --- ParallelTerminationStrategy: PID 8142 died... 10:20:52.969627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8142): Terminated: ok {rc=0} 10:20:53.017115 --- ParallelTerminationStrategy: PID 8145 died... 10:20:53.037354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8145): Terminated: ok {rc=0} 10:20:53.084616 --- ParallelTerminationStrategy: PID 8148 died... 10:20:53.105068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8148): Terminated: ok {rc=0} 10:20:53.195071 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:20:54.488163 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:20:54.494707 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:20:54.515682 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:20:54.554902 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:20:54.641179 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:20:54.661696 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:20:54.699689 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:20:55.292826 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:20:55.342822 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:20:55.353644 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:20:55.408938 tst cs_paging_gprs_active.py: using LAC 33275 10:20:55.531790 tst cs_paging_gprs_active.py: using RAC 125 10:20:55.656258 tst cs_paging_gprs_active.py: using CellId 33275 10:20:55.779728 tst cs_paging_gprs_active.py: using BVCI 33276 10:20:55.894843 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:20:55.905768 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:20:55.916291 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:20:55.926944 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:20:55.937474 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:20:55.948020 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:20:55.958702 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:20:55.969753 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:20:55.980653 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:20:56.100172 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:20:56.223348 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:20:56.451154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:56.788901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8156): Launched 10:20:57.081713 run iperf3-srv_10.42.42.10(pid=8157): Launched 10:20:57.208133 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:20:57.433546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:57.770173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8158): Launched 10:20:58.063578 run iperf3-srv_10.42.42.10(pid=8159): Launched 10:20:58.188502 tst cs_paging_gprs_active.py:38: start network... 10:20:58.415258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:58.934365 run create_hlr_db(pid=8160): Launched 10:20:59.063892 bus /gobi_6: Setting Powered False 10:21:00.129132 run create_hlr_db(pid=8160): Terminated: ok {rc=0} 10:21:00.594538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8162): Launched 10:21:00.949781 run osmo-hlr_10.42.42.2(pid=8163): Launched 10:21:01.125904 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:01.881148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8165): Launched 10:21:02.274488 run osmo-stp_10.42.42.5(pid=8166): Launched 10:21:02.496834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:21:03.075333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8168): Launched 10:21:03.204353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:21:03.489246 run patchelf(pid=8169): Launched 10:21:03.675909 run osmo-stp_10.42.42.5(pid=8166): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8166)] 10:21:03.816846 run osmo-stp_10.42.42.5(pid=8166): stdout: | (launched: 2022-12-13_10:21:02.213398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:03.959592 run osmo-stp_10.42.42.5(pid=8166): stderr: | 20221213102102504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102102504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102102504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102102505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102102505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102102505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102102505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:04.101965 run osmo-stp_10.42.42.5(pid=8166): stdout: | (launched: 2022-12-13_10:21:02.213398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:04.238762 run osmo-stp_10.42.42.5(pid=8166): stderr: | 20221213102102504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102102504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102102504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102102505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102102505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102102505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102102505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:04.401159 run patchelf(pid=8169): Terminating (SIGINT) 10:21:04.588233 run patchelf(pid=8169): Terminated: ok {rc=0} 10:21:04.723369 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8166): Process ended prematurely: osmo-stp_10.42.42.5(pid=8166) [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8166)] [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:21:04.733642 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 10:21:04.762177 run osmo-hlr_10.42.42.2(pid=8163): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8163)] 10:21:04.813403 run osmo-hlr_10.42.42.2(pid=8163): stdout: | (launched: 2022-12-13_10:21:00.874035) 10:21:04.866387 run osmo-hlr_10.42.42.2(pid=8163): stderr: | 20221213102101266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102101266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102101267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102101267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102101267 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102101267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102101292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102101312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102101312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102101312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:04.919686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8156): Terminating (SIGTERM) 10:21:04.962149 run iperf3-srv_10.42.42.10(pid=8157): Terminating (SIGTERM) 10:21:05.005481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8158): Terminating (SIGTERM) 10:21:05.048296 run iperf3-srv_10.42.42.10(pid=8159): Terminating (SIGTERM) 10:21:05.091469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8162): Terminating (SIGTERM) 10:21:05.134773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8165): Terminating (SIGTERM) 10:21:05.177473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8168): Terminating (SIGTERM) 10:21:05.220355 --- ParallelTerminationStrategy: PID 8156 died... 10:21:05.241108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8156): Terminated: ok {rc=0} 10:21:05.288317 --- ParallelTerminationStrategy: PID 8157 died... 10:21:05.308312 run iperf3-srv_10.42.42.10(pid=8157): Terminated {rc=256} 10:21:05.355359 --- ParallelTerminationStrategy: PID 8158 died... 10:21:05.375657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8158): Terminated: ok {rc=0} 10:21:05.422598 --- ParallelTerminationStrategy: PID 8159 died... 10:21:05.442610 run iperf3-srv_10.42.42.10(pid=8159): Terminated {rc=256} 10:21:05.489515 --- ParallelTerminationStrategy: PID 8162 died... 10:21:05.509694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8162): Terminated: ok {rc=0} 10:21:05.556594 --- ParallelTerminationStrategy: PID 8165 died... 10:21:05.576762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8165): Terminated: ok {rc=0} 10:21:05.623528 --- ParallelTerminationStrategy: PID 8168 died... 10:21:05.643789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8168): Terminated: ok {rc=0} 10:21:05.733044 bus /gobi_0: Setting Powered False 10:21:06.832278 bus /gobi_0: Setting Powered False 10:21:07.950115 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:21:09.103022 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:09.115216 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:21:09.176669 tst iperf3.py: using LAC 33276 10:21:09.300300 tst iperf3.py: using RAC 126 10:21:09.433474 tst iperf3.py: using CellId 33276 10:21:09.556764 tst iperf3.py: using BVCI 33277 10:21:09.671713 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:09.682787 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:09.693631 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:09.704484 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:09.715791 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:09.726726 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:09.737712 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:09.748462 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:09.759527 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:09.875814 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:21:10.083526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:10.398295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8170): Launched 10:21:10.672061 run iperf3-srv_10.42.42.10(pid=8171): Launched 10:21:10.790106 tst iperf3.py:8: start network... 10:21:10.997603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:11.479671 run create_hlr_db(pid=8172): Launched 10:21:11.607768 bus /gobi_6: Setting Powered False 10:21:12.669829 run create_hlr_db(pid=8172): Terminated: ok {rc=0} 10:21:13.102828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8174): Launched 10:21:13.414808 run osmo-hlr_10.42.42.2(pid=8175): Launched 10:21:13.532940 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:14.085680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8177): Launched 10:21:14.397658 run osmo-stp_10.42.42.5(pid=8178): Launched 10:21:14.516123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:21:15.050621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8180): Launched 10:21:15.168604 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:21:15.432288 run patchelf(pid=8181): Launched 10:21:15.606172 run osmo-stp_10.42.42.5(pid=8178): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8178)] 10:21:15.737609 run osmo-stp_10.42.42.5(pid=8178): stdout: | (launched: 2022-12-13_10:21:14.338313) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:15.878371 run osmo-stp_10.42.42.5(pid=8178): stderr: | 20221213102114512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102114512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102114512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102114513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102114513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102114513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102114513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:16.013392 run osmo-stp_10.42.42.5(pid=8178): stdout: | (launched: 2022-12-13_10:21:14.338313) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:16.142730 run osmo-stp_10.42.42.5(pid=8178): stderr: | 20221213102114512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102114512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102114512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102114513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102114513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102114513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102114513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:16.296432 run patchelf(pid=8181): Terminating (SIGINT) 10:21:16.473823 run patchelf(pid=8181): Terminated: ok {rc=0} 10:21:16.601974 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8178): Process ended prematurely: osmo-stp_10.42.42.5(pid=8178) [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8178)] [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 10:21:16.612528 tst iperf3.py:8: Test FAILED (7.5 sec) 10:21:16.641039 run osmo-hlr_10.42.42.2(pid=8175): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8175)] 10:21:16.691760 run osmo-hlr_10.42.42.2(pid=8175): stdout: | (launched: 2022-12-13_10:21:13.355742) 10:21:16.742708 run osmo-hlr_10.42.42.2(pid=8175): stderr: | 20221213102113534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102113534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102113534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102113534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102113534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102113534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102113546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102113555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102113555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102113555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:16.794222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8170): Terminating (SIGTERM) 10:21:16.835745 run iperf3-srv_10.42.42.10(pid=8171): Terminating (SIGTERM) 10:21:16.877641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8174): Terminating (SIGTERM) 10:21:16.919477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8177): Terminating (SIGTERM) 10:21:16.961377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8180): Terminating (SIGTERM) 10:21:17.004022 --- ParallelTerminationStrategy: PID 8170 died... 10:21:17.024400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8170): Terminated: ok {rc=0} 10:21:17.071468 --- ParallelTerminationStrategy: PID 8171 died... 10:21:17.090933 run iperf3-srv_10.42.42.10(pid=8171): Terminated {rc=256} 10:21:17.136755 --- ParallelTerminationStrategy: PID 8174 died... 10:21:17.156367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8174): Terminated: ok {rc=0} 10:21:17.201274 --- ParallelTerminationStrategy: PID 8177 died... 10:21:17.220599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8177): Terminated: ok {rc=0} 10:21:17.265695 --- ParallelTerminationStrategy: PID 8180 died... 10:21:17.284447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8180): Terminated: ok {rc=0} 10:21:17.369263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:21:18.520847 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:18.533464 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:21:18.593484 tst iperf3m4.py: using LAC 33277 10:21:18.716203 tst iperf3m4.py: using RAC 127 10:21:18.840466 tst iperf3m4.py: using CellId 33277 10:21:18.963524 tst iperf3m4.py: using BVCI 33278 10:21:19.078006 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:19.089138 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:19.099791 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:19.110648 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:19.121417 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:19.132217 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:19.143142 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:19.153784 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:19.164514 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:19.286653 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:19.407860 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:19.527720 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:19.644942 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:21:19.854393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:20.168739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8182): Launched 10:21:20.442374 run iperf3-srv_10.42.42.10(pid=8183): Launched 10:21:20.560902 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:21:20.768422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:21.082429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8184): Launched 10:21:21.356409 run iperf3-srv_10.42.42.10(pid=8185): Launched 10:21:21.474672 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:21:21.682199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:21.996363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8186): Launched 10:21:22.271151 run iperf3-srv_10.42.42.10(pid=8187): Launched 10:21:22.389385 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:21:22.597161 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:22.910868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8188): Launched 10:21:23.183119 run iperf3-srv_10.42.42.10(pid=8189): Launched 10:21:23.299027 tst iperf3m4.py:8: start network... 10:21:23.506435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:23.989441 run create_hlr_db(pid=8190): Launched 10:21:24.117462 bus /gobi_6: Setting Powered False 10:21:25.179192 run create_hlr_db(pid=8190): Terminated: ok {rc=0} 10:21:25.635996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8192): Launched 10:21:25.971414 run osmo-hlr_10.42.42.2(pid=8193): Launched 10:21:26.099187 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:26.679342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8195): Launched 10:21:27.013670 run osmo-stp_10.42.42.5(pid=8196): Launched 10:21:27.141280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:21:27.716852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8198): Launched 10:21:27.845553 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:21:28.129569 run patchelf(pid=8199): Launched 10:21:28.315364 run osmo-stp_10.42.42.5(pid=8196): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8196)] 10:21:28.456803 run osmo-stp_10.42.42.5(pid=8196): stdout: | (launched: 2022-12-13_10:21:26.950646) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:28.598792 run osmo-stp_10.42.42.5(pid=8196): stderr: | 20221213102127141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102127142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102127142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102127142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102127143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102127143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102127143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:28.741683 run osmo-stp_10.42.42.5(pid=8196): stdout: | (launched: 2022-12-13_10:21:26.950646) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:28.878068 run osmo-stp_10.42.42.5(pid=8196): stderr: | 20221213102127141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102127142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102127142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102127142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102127143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102127143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102127143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:29.039760 run patchelf(pid=8199): Terminating (SIGINT) 10:21:29.227581 run patchelf(pid=8199): Terminated: ok {rc=0} 10:21:29.363536 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8196): Process ended prematurely: osmo-stp_10.42.42.5(pid=8196) [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8196)] [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:21:29.373806 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:21:29.403142 run osmo-hlr_10.42.42.2(pid=8193): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8193)] 10:21:29.454623 run osmo-hlr_10.42.42.2(pid=8193): stdout: | (launched: 2022-12-13_10:21:25.908640) 10:21:29.507871 run osmo-hlr_10.42.42.2(pid=8193): stderr: | 20221213102126105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102126106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102126106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102126106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102126106 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102126106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102126118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102126127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102126127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102126127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:29.561590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8182): Terminating (SIGTERM) 10:21:29.604318 run iperf3-srv_10.42.42.10(pid=8183): Terminating (SIGTERM) 10:21:29.647308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8184): Terminating (SIGTERM) 10:21:29.690427 run iperf3-srv_10.42.42.10(pid=8185): Terminating (SIGTERM) 10:21:29.733224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8186): Terminating (SIGTERM) 10:21:29.776218 run iperf3-srv_10.42.42.10(pid=8187): Terminating (SIGTERM) 10:21:29.818983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8188): Terminating (SIGTERM) 10:21:29.862012 run iperf3-srv_10.42.42.10(pid=8189): Terminating (SIGTERM) 10:21:29.904831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8192): Terminating (SIGTERM) 10:21:29.947802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8195): Terminating (SIGTERM) 10:21:29.990659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8198): Terminating (SIGTERM) 10:21:30.033510 --- ParallelTerminationStrategy: PID 8182 died... 10:21:30.054268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8182): Terminated: ok {rc=0} 10:21:30.101614 --- ParallelTerminationStrategy: PID 8183 died... 10:21:30.121806 run iperf3-srv_10.42.42.10(pid=8183): Terminated {rc=256} 10:21:30.168919 --- ParallelTerminationStrategy: PID 8184 died... 10:21:30.189567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8184): Terminated: ok {rc=0} 10:21:30.236876 --- ParallelTerminationStrategy: PID 8185 died... 10:21:30.257668 run iperf3-srv_10.42.42.10(pid=8185): Terminated {rc=256} 10:21:30.304641 --- ParallelTerminationStrategy: PID 8186 died... 10:21:30.325006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8186): Terminated: ok {rc=0} 10:21:30.372412 --- ParallelTerminationStrategy: PID 8187 died... 10:21:30.392578 run iperf3-srv_10.42.42.10(pid=8187): Terminated {rc=256} 10:21:30.440206 --- ParallelTerminationStrategy: PID 8188 died... 10:21:30.460386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8188): Terminated: ok {rc=0} 10:21:30.507491 --- ParallelTerminationStrategy: PID 8189 died... 10:21:30.527759 run iperf3-srv_10.42.42.10(pid=8189): Terminated {rc=256} 10:21:30.574753 --- ParallelTerminationStrategy: PID 8192 died... 10:21:30.594845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8192): Terminated: ok {rc=0} 10:21:30.642018 --- ParallelTerminationStrategy: PID 8195 died... 10:21:30.662348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8195): Terminated: ok {rc=0} 10:21:30.709290 --- ParallelTerminationStrategy: PID 8198 died... 10:21:30.729674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8198): Terminated: ok {rc=0} 10:21:30.819569 bus /gobi_4: Setting Powered False 10:21:31.933164 bus /gobi_4: Setting Powered False 10:21:33.049393 bus /gobi_1: Setting Powered False 10:21:34.149998 bus /gobi_1: Setting Powered False 10:21:35.268479 bus /gobi_0: Setting Powered False 10:21:36.368379 bus /gobi_0: Setting Powered False 10:21:37.487463 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:21:38.592478 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:38.605202 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:21:38.664418 tst ping.py: using LAC 33278 10:21:38.795179 tst ping.py: using RAC 128 10:21:38.923143 tst ping.py: using CellId 33278 10:21:39.052904 tst ping.py: using BVCI 33279 10:21:39.171344 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:39.182832 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:39.194566 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:39.205823 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:39.217316 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:39.228669 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:39.240296 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:39.251905 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:39.374184 tst ping.py:19: start network... 10:21:39.594950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:40.104174 run create_hlr_db(pid=8200): Launched 10:21:40.231082 bus /gobi_6: Setting Powered False 10:21:41.295441 run create_hlr_db(pid=8200): Terminated: ok {rc=0} 10:21:41.736266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8202): Launched 10:21:42.045887 run osmo-hlr_10.42.42.2(pid=8203): Launched 10:21:42.163684 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:42.692497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8205): Launched 10:21:43.001029 run osmo-stp_10.42.42.5(pid=8206): Launched 10:21:43.116649 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:21:43.661207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8208): Launched 10:21:43.779807 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:21:44.040424 run patchelf(pid=8209): Launched 10:21:44.211333 run osmo-stp_10.42.42.5(pid=8206): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8206)] 10:21:44.340641 run osmo-stp_10.42.42.5(pid=8206): stdout: | (launched: 2022-12-13_10:21:42.942708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:44.471738 run osmo-stp_10.42.42.5(pid=8206): stderr: | 20221213102143113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102143114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102143114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102143114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102143115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102143115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102143115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:44.602925 run osmo-stp_10.42.42.5(pid=8206): stdout: | (launched: 2022-12-13_10:21:42.942708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:44.728303 run osmo-stp_10.42.42.5(pid=8206): stderr: | 20221213102143113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102143114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102143114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102143114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102143115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102143115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102143115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:44.876801 run patchelf(pid=8209): Terminating (SIGINT) 10:21:45.048696 run patchelf(pid=8209): Terminated: ok {rc=0} 10:21:45.172669 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8206): Process ended prematurely: osmo-stp_10.42.42.5(pid=8206) [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8206)] [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 10:21:45.181661 tst ping.py:22: Test FAILED (6.6 sec) 10:21:45.209233 run osmo-hlr_10.42.42.2(pid=8203): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8203)] 10:21:45.257723 run osmo-hlr_10.42.42.2(pid=8203): stdout: | (launched: 2022-12-13_10:21:41.987495) 10:21:45.307845 run osmo-hlr_10.42.42.2(pid=8203): stderr: | 20221213102142166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102142166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102142166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102142166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102142166 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102142166 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102142181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102142192 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102142192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102142192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:45.358471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8202): Terminating (SIGTERM) 10:21:45.399233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8205): Terminating (SIGTERM) 10:21:45.440069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8208): Terminating (SIGTERM) 10:21:45.481235 --- ParallelTerminationStrategy: PID 8202 died... 10:21:45.500485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8202): Terminated: ok {rc=0} 10:21:45.545695 --- ParallelTerminationStrategy: PID 8205 died... 10:21:45.564783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8205): Terminated: ok {rc=0} 10:21:45.609954 --- ParallelTerminationStrategy: PID 8208 died... 10:21:45.629319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8208): Terminated: ok {rc=0} 10:21:45.716725 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:21:46.812683 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:46.830528 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:21:46.907572 tst ping_idle_ping.py: using LAC 33279 10:21:47.040422 tst ping_idle_ping.py: using RAC 129 10:21:47.203193 tst ping_idle_ping.py: using CellId 33279 10:21:47.342041 tst ping_idle_ping.py: using BVCI 33280 10:21:47.463072 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:47.474572 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:47.485806 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:47.497094 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:47.508538 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:47.519965 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:47.531603 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:47.543063 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:47.665590 tst ping_idle_ping.py:24: start network... 10:21:47.870964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:48.351399 run create_hlr_db(pid=8210): Launched 10:21:48.477889 bus /gobi_6: Setting Powered False 10:21:49.538882 run create_hlr_db(pid=8210): Terminated: ok {rc=0} 10:21:49.969362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8212): Launched 10:21:50.279760 run osmo-hlr_10.42.42.2(pid=8213): Launched 10:21:50.397706 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:50.937500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8215): Launched 10:21:51.247158 run osmo-stp_10.42.42.5(pid=8216): Launched 10:21:51.367288 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:21:51.898732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8218): Launched 10:21:52.015807 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:21:52.278119 run patchelf(pid=8219): Launched 10:21:52.449734 run osmo-stp_10.42.42.5(pid=8216): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8216)] 10:21:52.579295 run osmo-stp_10.42.42.5(pid=8216): stdout: | (launched: 2022-12-13_10:21:51.188447) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:52.710748 run osmo-stp_10.42.42.5(pid=8216): stderr: | 20221213102151361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102151361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102151361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102151362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102151362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102151362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102151363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:52.842476 run osmo-stp_10.42.42.5(pid=8216): stdout: | (launched: 2022-12-13_10:21:51.188447) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:52.967763 run osmo-stp_10.42.42.5(pid=8216): stderr: | 20221213102151361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102151361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102151361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102151362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102151362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102151362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102151363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:53.116722 run patchelf(pid=8219): Terminating (SIGINT) 10:21:53.288819 run patchelf(pid=8219): Terminated: ok {rc=0} 10:21:53.413182 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8216): Process ended prematurely: osmo-stp_10.42.42.5(pid=8216) [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8216)] [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:21:53.422071 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:21:53.448698 run osmo-hlr_10.42.42.2(pid=8213): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8213)] 10:21:53.497359 run osmo-hlr_10.42.42.2(pid=8213): stdout: | (launched: 2022-12-13_10:21:50.220794) 10:21:53.547253 run osmo-hlr_10.42.42.2(pid=8213): stderr: | 20221213102150400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102150400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102150400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102150400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102150400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102150400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102150412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102150421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102150421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102150421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:53.597649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8212): Terminating (SIGTERM) 10:21:53.638254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8215): Terminating (SIGTERM) 10:21:53.678677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8218): Terminating (SIGTERM) 10:21:53.719482 --- ParallelTerminationStrategy: PID 8212 died... 10:21:53.739045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8212): Terminated: ok {rc=0} 10:21:53.783879 --- ParallelTerminationStrategy: PID 8215 died... 10:21:53.803120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8215): Terminated: ok {rc=0} 10:21:53.847846 --- ParallelTerminationStrategy: PID 8218 died... 10:21:53.867097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8218): Terminated: ok {rc=0} 10:21:53.954277 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:21:55.246507 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:21:55.252539 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:21:55.273707 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:21:55.311938 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:21:55.398320 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:21:55.418776 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:21:55.456588 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:21:56.050421 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:21:56.100855 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:21:56.111792 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:21:56.168472 tst cs_paging_gprs_active.py: using LAC 33280 10:21:56.292347 tst cs_paging_gprs_active.py: using RAC 130 10:21:56.418598 tst cs_paging_gprs_active.py: using CellId 33280 10:21:56.550043 tst cs_paging_gprs_active.py: using BVCI 33281 10:21:56.673280 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:21:56.684827 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:21:56.696089 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:21:56.707238 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:21:56.718839 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:21:56.730349 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:21:56.741859 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:21:56.753205 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:21:56.764691 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:21:56.882695 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:21:57.000673 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:21:57.210161 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:57.544538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8223): Launched 10:21:57.836358 run iperf3-srv_10.42.42.10(pid=8224): Launched 10:21:57.962899 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:21:58.188621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:58.525881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8225): Launched 10:21:58.818645 run iperf3-srv_10.42.42.10(pid=8226): Launched 10:21:58.944786 tst cs_paging_gprs_active.py:38: start network... 10:21:59.169528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:59.687906 run create_hlr_db(pid=8227): Launched 10:21:59.815474 bus /gobi_6: Setting Powered False 10:22:00.881873 run create_hlr_db(pid=8227): Terminated: ok {rc=0} 10:22:01.407100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8229): Launched 10:22:01.743710 run osmo-hlr_10.42.42.2(pid=8230): Launched 10:22:01.991673 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:02.667906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8232): Launched 10:22:02.982111 run osmo-stp_10.42.42.5(pid=8233): Launched 10:22:03.099622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:03.637129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8235): Launched 10:22:03.755335 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:04.019881 run patchelf(pid=8236): Launched 10:22:04.194608 run osmo-stp_10.42.42.5(pid=8233): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8233)] 10:22:04.325442 run osmo-stp_10.42.42.5(pid=8233): stdout: | (launched: 2022-12-13_10:22:02.923065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:04.458213 run osmo-stp_10.42.42.5(pid=8233): stderr: | 20221213102203096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102203096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102203097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102203097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102203098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102203098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102203098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:04.590699 run osmo-stp_10.42.42.5(pid=8233): stdout: | (launched: 2022-12-13_10:22:02.923065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:04.717446 run osmo-stp_10.42.42.5(pid=8233): stderr: | 20221213102203096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102203096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102203097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102203097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102203098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102203098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102203098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:04.867578 run patchelf(pid=8236): Terminating (SIGINT) 10:22:05.042164 run patchelf(pid=8236): Terminated: ok {rc=0} 10:22:05.168206 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8233): Process ended prematurely: osmo-stp_10.42.42.5(pid=8233) [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8233)] [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:22:05.177795 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 10:22:05.204614 run osmo-hlr_10.42.42.2(pid=8230): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8230)] 10:22:05.252067 run osmo-hlr_10.42.42.2(pid=8230): stdout: | (launched: 2022-12-13_10:22:01.683332) 10:22:05.301443 run osmo-hlr_10.42.42.2(pid=8230): stderr: | 20221213102202017 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102202017 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102202017 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102202017 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102202017 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102202018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102202040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102202048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102202057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102202057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:05.351482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8223): Terminating (SIGTERM) 10:22:05.391411 run iperf3-srv_10.42.42.10(pid=8224): Terminating (SIGTERM) 10:22:05.431295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8225): Terminating (SIGTERM) 10:22:05.471019 run iperf3-srv_10.42.42.10(pid=8226): Terminating (SIGTERM) 10:22:05.510616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8229): Terminating (SIGTERM) 10:22:05.550356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8232): Terminating (SIGTERM) 10:22:05.590085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8235): Terminating (SIGTERM) 10:22:05.629990 --- ParallelTerminationStrategy: PID 8223 died... 10:22:05.649159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8223): Terminated: ok {rc=0} 10:22:05.693109 --- ParallelTerminationStrategy: PID 8224 died... 10:22:05.711486 run iperf3-srv_10.42.42.10(pid=8224): Terminated {rc=256} 10:22:05.755076 --- ParallelTerminationStrategy: PID 8225 died... 10:22:05.773519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8225): Terminated: ok {rc=0} 10:22:05.817386 --- ParallelTerminationStrategy: PID 8226 died... 10:22:05.835761 run iperf3-srv_10.42.42.10(pid=8226): Terminated {rc=256} 10:22:05.879378 --- ParallelTerminationStrategy: PID 8229 died... 10:22:05.897997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8229): Terminated: ok {rc=0} 10:22:05.941797 --- ParallelTerminationStrategy: PID 8232 died... 10:22:05.960362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8232): Terminated: ok {rc=0} 10:22:06.004082 --- ParallelTerminationStrategy: PID 8235 died... 10:22:06.022688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8235): Terminated: ok {rc=0} 10:22:06.106435 bus /gobi_0: Setting Powered False 10:22:07.205534 bus /gobi_0: Setting Powered False 10:22:08.322956 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:22:09.474771 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:09.486793 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:22:09.548229 tst iperf3.py: using LAC 33281 10:22:09.679765 tst iperf3.py: using RAC 131 10:22:09.811015 tst iperf3.py: using CellId 33281 10:22:09.942450 tst iperf3.py: using BVCI 33282 10:22:10.065152 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:10.076543 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:10.087707 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:10.098873 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:10.110287 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:10.121648 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:10.133176 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:10.144444 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:10.156006 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:10.277937 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:22:10.487683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:10.803243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8237): Launched 10:22:11.077934 run iperf3-srv_10.42.42.10(pid=8238): Launched 10:22:11.196280 tst iperf3.py:8: start network... 10:22:11.403585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:11.885759 run create_hlr_db(pid=8239): Launched 10:22:12.012487 bus /gobi_6: Setting Powered False 10:22:13.074068 run create_hlr_db(pid=8239): Terminated: ok {rc=0} 10:22:13.508500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8241): Launched 10:22:13.822290 run osmo-hlr_10.42.42.2(pid=8242): Launched 10:22:13.939197 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:14.474121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8244): Launched 10:22:14.786037 run osmo-stp_10.42.42.5(pid=8245): Launched 10:22:14.904673 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:15.440667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8247): Launched 10:22:15.559737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:15.823481 run patchelf(pid=8248): Launched 10:22:16.002934 run osmo-stp_10.42.42.5(pid=8245): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8245)] 10:22:16.135851 run osmo-stp_10.42.42.5(pid=8245): stdout: | (launched: 2022-12-13_10:22:14.726505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:16.270639 run osmo-stp_10.42.42.5(pid=8245): stderr: | 20221213102214899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102214900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102214900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102214900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102214901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102214901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102214901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:16.405157 run osmo-stp_10.42.42.5(pid=8245): stdout: | (launched: 2022-12-13_10:22:14.726505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:16.533568 run osmo-stp_10.42.42.5(pid=8245): stderr: | 20221213102214899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102214900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102214900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102214900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102214901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102214901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102214901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:16.686134 run patchelf(pid=8248): Terminating (SIGINT) 10:22:16.862389 run patchelf(pid=8248): Terminated: ok {rc=0} 10:22:16.990940 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8245): Process ended prematurely: osmo-stp_10.42.42.5(pid=8245) [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8245)] [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 10:22:17.001795 tst iperf3.py:8: Test FAILED (7.6 sec) 10:22:17.030047 run osmo-hlr_10.42.42.2(pid=8242): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8242)] 10:22:17.078831 run osmo-hlr_10.42.42.2(pid=8242): stdout: | (launched: 2022-12-13_10:22:13.763227) 10:22:17.129492 run osmo-hlr_10.42.42.2(pid=8242): stderr: | 20221213102213942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102213942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102213942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102213942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102213942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102213942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102213957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102213967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102213968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102213968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:17.180153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8237): Terminating (SIGTERM) 10:22:17.220702 run iperf3-srv_10.42.42.10(pid=8238): Terminating (SIGTERM) 10:22:17.261172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8241): Terminating (SIGTERM) 10:22:17.301545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8244): Terminating (SIGTERM) 10:22:17.341650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8247): Terminating (SIGTERM) 10:22:17.381887 --- ParallelTerminationStrategy: PID 8237 died... 10:22:17.401126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8237): Terminated: ok {rc=0} 10:22:17.445487 --- ParallelTerminationStrategy: PID 8238 died... 10:22:17.464277 run iperf3-srv_10.42.42.10(pid=8238): Terminated {rc=256} 10:22:17.508248 --- ParallelTerminationStrategy: PID 8241 died... 10:22:17.527142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8241): Terminated: ok {rc=0} 10:22:17.571074 --- ParallelTerminationStrategy: PID 8244 died... 10:22:17.589843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8244): Terminated: ok {rc=0} 10:22:17.633800 --- ParallelTerminationStrategy: PID 8247 died... 10:22:17.652588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8247): Terminated: ok {rc=0} 10:22:17.739018 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:22:18.889208 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:18.900830 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:22:18.959636 tst iperf3m4.py: using LAC 33282 10:22:19.082763 tst iperf3m4.py: using RAC 132 10:22:19.205525 tst iperf3m4.py: using CellId 33282 10:22:19.326611 tst iperf3m4.py: using BVCI 33283 10:22:19.441283 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:19.452113 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:19.463136 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:19.473853 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:19.484365 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:19.495115 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:19.505943 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:19.516474 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:19.527290 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:19.651327 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:19.774147 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:19.898374 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:20.018602 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:22:20.227761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:20.543843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8249): Launched 10:22:20.817150 run iperf3-srv_10.42.42.10(pid=8250): Launched 10:22:20.934621 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:22:21.141796 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:21.455109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8251): Launched 10:22:21.728860 run iperf3-srv_10.42.42.10(pid=8252): Launched 10:22:21.846232 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:22:22.053133 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:22.366261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8253): Launched 10:22:22.637573 run iperf3-srv_10.42.42.10(pid=8254): Launched 10:22:22.753684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:22:22.959959 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:23.272415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8255): Launched 10:22:23.545801 run iperf3-srv_10.42.42.10(pid=8256): Launched 10:22:23.661366 tst iperf3m4.py:8: start network... 10:22:23.867365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:24.348650 run create_hlr_db(pid=8257): Launched 10:22:24.476625 bus /gobi_6: Setting Powered False 10:22:25.538387 run create_hlr_db(pid=8257): Terminated: ok {rc=0} 10:22:25.994063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8259): Launched 10:22:26.329943 run osmo-hlr_10.42.42.2(pid=8260): Launched 10:22:26.458796 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:27.036620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8262): Launched 10:22:27.373780 run osmo-stp_10.42.42.5(pid=8263): Launched 10:22:27.504887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:28.082317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8265): Launched 10:22:28.209702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:28.494583 run patchelf(pid=8266): Launched 10:22:28.680855 run osmo-stp_10.42.42.5(pid=8263): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8263)] 10:22:28.822069 run osmo-stp_10.42.42.5(pid=8263): stdout: | (launched: 2022-12-13_10:22:27.310472) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:28.964483 run osmo-stp_10.42.42.5(pid=8263): stderr: | 20221213102227501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102227501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102227501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102227501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102227502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102227502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102227502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:29.107248 run osmo-stp_10.42.42.5(pid=8263): stdout: | (launched: 2022-12-13_10:22:27.310472) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:29.244389 run osmo-stp_10.42.42.5(pid=8263): stderr: | 20221213102227501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102227501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102227501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102227501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102227502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102227502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102227502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:29.406978 run patchelf(pid=8266): Terminating (SIGINT) 10:22:29.594138 run patchelf(pid=8266): Terminated: ok {rc=0} 10:22:29.728783 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8263): Process ended prematurely: osmo-stp_10.42.42.5(pid=8263) [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8263)] [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:22:29.739146 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:22:29.768156 run osmo-hlr_10.42.42.2(pid=8260): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8260)] 10:22:29.819824 run osmo-hlr_10.42.42.2(pid=8260): stdout: | (launched: 2022-12-13_10:22:26.267202) 10:22:29.873378 run osmo-hlr_10.42.42.2(pid=8260): stderr: | 20221213102226464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102226464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102226465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102226465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102226465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102226465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102226477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102226486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102226487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102226487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:29.926779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8249): Terminating (SIGTERM) 10:22:29.969419 run iperf3-srv_10.42.42.10(pid=8250): Terminating (SIGTERM) 10:22:30.012434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8251): Terminating (SIGTERM) 10:22:30.055328 run iperf3-srv_10.42.42.10(pid=8252): Terminating (SIGTERM) 10:22:30.098298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8253): Terminating (SIGTERM) 10:22:30.141730 run iperf3-srv_10.42.42.10(pid=8254): Terminating (SIGTERM) 10:22:30.184520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8255): Terminating (SIGTERM) 10:22:30.227580 run iperf3-srv_10.42.42.10(pid=8256): Terminating (SIGTERM) 10:22:30.270527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8259): Terminating (SIGTERM) 10:22:30.313546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8262): Terminating (SIGTERM) 10:22:30.356382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8265): Terminating (SIGTERM) 10:22:30.399914 --- ParallelTerminationStrategy: PID 8249 died... 10:22:30.420925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8249): Terminated: ok {rc=0} 10:22:30.468584 --- ParallelTerminationStrategy: PID 8250 died... 10:22:30.489126 run iperf3-srv_10.42.42.10(pid=8250): Terminated {rc=256} 10:22:30.536542 --- ParallelTerminationStrategy: PID 8251 died... 10:22:30.557059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8251): Terminated: ok {rc=0} 10:22:30.604153 --- ParallelTerminationStrategy: PID 8252 died... 10:22:30.624360 run iperf3-srv_10.42.42.10(pid=8252): Terminated {rc=256} 10:22:30.671421 --- ParallelTerminationStrategy: PID 8253 died... 10:22:30.691728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8253): Terminated: ok {rc=0} 10:22:30.738954 --- ParallelTerminationStrategy: PID 8254 died... 10:22:30.759434 run iperf3-srv_10.42.42.10(pid=8254): Terminated {rc=256} 10:22:30.806546 --- ParallelTerminationStrategy: PID 8255 died... 10:22:30.826918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8255): Terminated: ok {rc=0} 10:22:30.883511 --- ParallelTerminationStrategy: PID 8256 died... 10:22:30.903985 run iperf3-srv_10.42.42.10(pid=8256): Terminated {rc=256} 10:22:30.956469 --- ParallelTerminationStrategy: PID 8259 died... 10:22:30.976412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8259): Terminated: ok {rc=0} 10:22:31.025092 --- ParallelTerminationStrategy: PID 8262 died... 10:22:31.046236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8262): Terminated: ok {rc=0} 10:22:31.093467 --- ParallelTerminationStrategy: PID 8265 died... 10:22:31.114180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8265): Terminated: ok {rc=0} 10:22:31.202216 bus /gobi_4: Setting Powered False 10:22:32.299554 bus /gobi_4: Setting Powered False 10:22:33.413824 bus /gobi_1: Setting Powered False 10:22:34.512809 bus /gobi_1: Setting Powered False 10:22:35.629971 bus /gobi_0: Setting Powered False 10:22:36.731307 bus /gobi_0: Setting Powered False 10:22:37.853248 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:22:38.959662 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:38.971955 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:22:39.033054 tst ping.py: using LAC 33283 10:22:39.161667 tst ping.py: using RAC 133 10:22:39.283757 tst ping.py: using CellId 33283 10:22:39.413446 tst ping.py: using BVCI 33284 10:22:39.527359 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:39.538590 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:39.549564 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:39.560530 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:39.571571 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:39.582665 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:39.593784 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:39.604718 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:39.723342 tst ping.py:19: start network... 10:22:39.927540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:40.403913 run create_hlr_db(pid=8267): Launched 10:22:40.529954 bus /gobi_6: Setting Powered False 10:22:41.594319 run create_hlr_db(pid=8267): Terminated: ok {rc=0} 10:22:42.051898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8269): Launched 10:22:42.382539 run osmo-hlr_10.42.42.2(pid=8270): Launched 10:22:42.507086 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:43.073669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8272): Launched 10:22:43.403733 run osmo-stp_10.42.42.5(pid=8273): Launched 10:22:43.530338 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:44.095808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8275): Launched 10:22:44.220605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:44.499997 run patchelf(pid=8276): Launched 10:22:44.682356 run osmo-stp_10.42.42.5(pid=8273): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8273)] 10:22:44.820365 run osmo-stp_10.42.42.5(pid=8273): stdout: | (launched: 2022-12-13_10:22:43.341457) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:44.959673 run osmo-stp_10.42.42.5(pid=8273): stderr: | 20221213102243531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102243531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102243531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102243531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102243532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102243532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102243532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:45.099400 run osmo-stp_10.42.42.5(pid=8273): stdout: | (launched: 2022-12-13_10:22:43.341457) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:45.233294 run osmo-stp_10.42.42.5(pid=8273): stderr: | 20221213102243531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102243531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102243531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102243531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102243532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102243532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102243532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:45.392436 run patchelf(pid=8276): Terminating (SIGINT) 10:22:45.575970 run patchelf(pid=8276): Terminated: ok {rc=0} 10:22:45.708240 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8273): Process ended prematurely: osmo-stp_10.42.42.5(pid=8273) [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8273)] [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 10:22:45.718067 tst ping.py:22: Test FAILED (6.8 sec) 10:22:45.746468 run osmo-hlr_10.42.42.2(pid=8270): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8270)] 10:22:45.797997 run osmo-hlr_10.42.42.2(pid=8270): stdout: | (launched: 2022-12-13_10:22:42.320325) 10:22:45.852216 run osmo-hlr_10.42.42.2(pid=8270): stderr: | 20221213102242519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102242519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102242520 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102242520 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102242520 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102242520 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102242531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102242539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102242539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102242539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:45.914399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8269): Terminating (SIGTERM) 10:22:45.964368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8272): Terminating (SIGTERM) 10:22:46.010496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8275): Terminating (SIGTERM) 10:22:46.055003 --- ParallelTerminationStrategy: PID 8269 died... 10:22:46.075981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8269): Terminated: ok {rc=0} 10:22:46.123522 --- ParallelTerminationStrategy: PID 8272 died... 10:22:46.143359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8272): Terminated: ok {rc=0} 10:22:46.190329 --- ParallelTerminationStrategy: PID 8275 died... 10:22:46.210296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8275): Terminated: ok {rc=0} 10:22:46.298903 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:22:47.385196 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:47.397341 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:22:47.455716 tst ping_idle_ping.py: using LAC 33284 10:22:47.576085 tst ping_idle_ping.py: using RAC 134 10:22:47.698652 tst ping_idle_ping.py: using CellId 33284 10:22:47.820561 tst ping_idle_ping.py: using BVCI 33285 10:22:47.932731 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:47.943920 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:47.954812 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:47.965818 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:47.976813 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:47.987920 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:47.999144 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:48.010098 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:48.132676 tst ping_idle_ping.py:24: start network... 10:22:48.354664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:48.873423 run create_hlr_db(pid=8277): Launched 10:22:48.999268 bus /gobi_6: Setting Powered False 10:22:50.063680 run create_hlr_db(pid=8277): Terminated: ok {rc=0} 10:22:50.512674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8279): Launched 10:22:50.841110 run osmo-hlr_10.42.42.2(pid=8280): Launched 10:22:50.967210 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:51.535067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8282): Launched 10:22:51.864290 run osmo-stp_10.42.42.5(pid=8283): Launched 10:22:51.990466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:52.523803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8285): Launched 10:22:52.642267 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:52.902640 run patchelf(pid=8286): Launched 10:22:53.073480 run osmo-stp_10.42.42.5(pid=8283): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8283)] 10:22:53.202835 run osmo-stp_10.42.42.5(pid=8283): stdout: | (launched: 2022-12-13_10:22:51.802616) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:53.333377 run osmo-stp_10.42.42.5(pid=8283): stderr: | 20221213102252060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102252061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102252061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102252061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102252062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102252062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102252062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:53.463904 run osmo-stp_10.42.42.5(pid=8283): stdout: | (launched: 2022-12-13_10:22:51.802616) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:53.588858 run osmo-stp_10.42.42.5(pid=8283): stderr: | 20221213102252060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102252061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102252061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102252061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102252062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102252062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102252062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:53.736833 run patchelf(pid=8286): Terminating (SIGINT) 10:22:53.908181 run patchelf(pid=8286): Terminated: ok {rc=0} 10:22:54.032236 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8283): Process ended prematurely: osmo-stp_10.42.42.5(pid=8283) [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8283)] [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:22:54.041510 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:22:54.068322 run osmo-hlr_10.42.42.2(pid=8280): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8280)] 10:22:54.116533 run osmo-hlr_10.42.42.2(pid=8280): stdout: | (launched: 2022-12-13_10:22:50.779344) 10:22:54.166306 run osmo-hlr_10.42.42.2(pid=8280): stderr: | 20221213102250973 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102250973 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102250973 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102250973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102250974 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102250974 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102250986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102250995 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102250995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102250995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:54.216582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8279): Terminating (SIGTERM) 10:22:54.257042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8282): Terminating (SIGTERM) 10:22:54.297275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8285): Terminating (SIGTERM) 10:22:54.337918 --- ParallelTerminationStrategy: PID 8279 died... 10:22:54.357556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8279): Terminated: ok {rc=0} 10:22:54.402151 --- ParallelTerminationStrategy: PID 8282 died... 10:22:54.421197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8282): Terminated: ok {rc=0} 10:22:54.465662 --- ParallelTerminationStrategy: PID 8285 died... 10:22:54.484680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8285): Terminated: ok {rc=0} 10:22:54.572035 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:22:55.861837 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:22:55.869851 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:22:55.891203 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:22:55.927766 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:22:55.982919 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:22:56.005085 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:22:56.040392 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:22:56.593844 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:22:56.600415 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:22:56.612919 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:22:56.671280 tst switch_tch_pdch.py: using LAC 33285 10:22:56.799508 tst switch_tch_pdch.py: using RAC 135 10:22:56.929059 tst switch_tch_pdch.py: using CellId 33285 10:22:57.055851 tst switch_tch_pdch.py: using BVCI 33286 10:22:57.174122 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:22:57.185793 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:22:57.197230 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:22:57.208493 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:22:57.220215 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:22:57.231958 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:22:57.243707 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:22:57.255409 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:22:57.372320 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:22:57.496718 tst switch_tch_pdch.py:51: start network... 10:22:57.717594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:58.226974 run create_hlr_db(pid=8291): Launched 10:22:58.351074 bus /gobi_6: Setting Powered False 10:22:59.415368 run create_hlr_db(pid=8291): Terminated: ok {rc=0} 10:22:59.873855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8293): Launched 10:23:00.202732 run osmo-hlr_10.42.42.2(pid=8294): Launched 10:23:00.328875 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:00.911916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8296): Launched 10:23:01.275604 run osmo-stp_10.42.42.5(pid=8297): Launched 10:23:01.523310 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:23:02.171850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8299): Launched 10:23:02.289642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:23:02.550416 run patchelf(pid=8300): Launched 10:23:02.720809 run osmo-stp_10.42.42.5(pid=8297): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8297)] 10:23:02.849733 run osmo-stp_10.42.42.5(pid=8297): stdout: | (launched: 2022-12-13_10:23:01.214585) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:02.980544 run osmo-stp_10.42.42.5(pid=8297): stderr: | 20221213102301504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102301504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102301505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102301505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102301506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102301506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102301506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:03.110808 run osmo-stp_10.42.42.5(pid=8297): stdout: | (launched: 2022-12-13_10:23:01.214585) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:03.235398 run osmo-stp_10.42.42.5(pid=8297): stderr: | 20221213102301504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102301504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102301505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102301505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102301506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102301506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102301506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:03.383328 run patchelf(pid=8300): Terminating (SIGINT) 10:23:03.554196 run patchelf(pid=8300): Terminated: ok {rc=0} 10:23:03.677703 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8297): Process ended prematurely: osmo-stp_10.42.42.5(pid=8297) [trial-2388↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8297)] [trial-2388↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:23:03.686649 tst switch_tch_pdch.py:54: Test FAILED (7.1 sec) 10:23:03.713459 run osmo-hlr_10.42.42.2(pid=8294): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8294)] 10:23:03.761815 run osmo-hlr_10.42.42.2(pid=8294): stdout: | (launched: 2022-12-13_10:23:00.140782) 10:23:03.811769 run osmo-hlr_10.42.42.2(pid=8294): stderr: | 20221213102300334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102300334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102300334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102300335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102300335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102300335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102300355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102300364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102300364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102300365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:03.862028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8293): Terminating (SIGTERM) 10:23:03.902298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8296): Terminating (SIGTERM) 10:23:03.942691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8299): Terminating (SIGTERM) 10:23:03.983176 --- ParallelTerminationStrategy: PID 8293 died... 10:23:04.002665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8293): Terminated: ok {rc=0} 10:23:04.047237 --- ParallelTerminationStrategy: PID 8296 died... 10:23:04.066236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8296): Terminated: ok {rc=0} 10:23:04.110806 --- ParallelTerminationStrategy: PID 8299 died... 10:23:04.129710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8299): Terminated: ok {rc=0} 10:23:04.216519 bus /gobi_0: Setting Powered False 10:23:05.316813 bus /gobi_0: Setting Powered False 10:23:06.434386 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:23:07.671763 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:07.677598 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:23:07.698108 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:23:07.732431 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:23:07.785240 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:23:07.806151 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:23:07.840581 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:23:08.398923 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:23:08.404589 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:08.416200 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:23:08.477610 tst switch_tch_pdch.py: using LAC 33286 10:23:08.604043 tst switch_tch_pdch.py: using RAC 136 10:23:08.730787 tst switch_tch_pdch.py: using CellId 33286 10:23:08.850515 tst switch_tch_pdch.py: using BVCI 33287 10:23:08.962468 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:08.973451 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:08.984089 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:08.994827 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:09.005469 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:09.016537 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:09.027409 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:09.038113 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:23:09.159123 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:23:09.279155 tst switch_tch_pdch.py:51: start network... 10:23:09.483655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:09.932262 run create_hlr_db(pid=8307): Launched 10:23:10.057875 bus /gobi_6: Setting Powered False 10:23:11.118552 run create_hlr_db(pid=8307): Terminated: ok {rc=0} 10:23:11.519707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8309): Launched 10:23:11.826823 run osmo-hlr_10.42.42.2(pid=8310): Launched 10:23:11.944030 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:12.441864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8312): Launched 10:23:12.750271 run osmo-stp_10.42.42.5(pid=8313): Launched 10:23:12.865649 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:23:13.367362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8315): Launched 10:23:13.484846 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:23:13.743557 run patchelf(pid=8316): Launched 10:23:13.913235 run osmo-stp_10.42.42.5(pid=8313): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8313)] 10:23:14.041565 run osmo-stp_10.42.42.5(pid=8313): stdout: | (launched: 2022-12-13_10:23:12.691727) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:14.171575 run osmo-stp_10.42.42.5(pid=8313): stderr: | 20221213102312865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102312865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102312865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102312865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102312866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102312866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102312866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:14.301651 run osmo-stp_10.42.42.5(pid=8313): stdout: | (launched: 2022-12-13_10:23:12.691727) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:14.426307 run osmo-stp_10.42.42.5(pid=8313): stderr: | 20221213102312865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102312865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102312865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102312865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102312866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102312866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102312866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:14.573858 run patchelf(pid=8316): Terminating (SIGINT) 10:23:14.745868 run patchelf(pid=8316): Terminated: ok {rc=0} 10:23:14.869311 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8313): Process ended prematurely: osmo-stp_10.42.42.5(pid=8313) [trial-2388↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8313)] [trial-2388↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:23:14.878347 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 10:23:14.904880 run osmo-hlr_10.42.42.2(pid=8310): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8310)] 10:23:14.953105 run osmo-hlr_10.42.42.2(pid=8310): stdout: | (launched: 2022-12-13_10:23:11.768772) 10:23:15.003045 run osmo-hlr_10.42.42.2(pid=8310): stderr: | 20221213102311945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102311945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102311945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102311945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102311945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102311945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102311957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102311965 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102311966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102311966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:15.053565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8309): Terminating (SIGTERM) 10:23:15.093839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8312): Terminating (SIGTERM) 10:23:15.134091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8315): Terminating (SIGTERM) 10:23:15.174632 --- ParallelTerminationStrategy: PID 8309 died... 10:23:15.193915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8309): Terminated: ok {rc=0} 10:23:15.238182 --- ParallelTerminationStrategy: PID 8312 died... 10:23:15.256907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8312): Terminated: ok {rc=0} 10:23:15.300911 --- ParallelTerminationStrategy: PID 8315 died... 10:23:15.319639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8315): Terminated: ok {rc=0} 10:23:15.403708 bus /gobi_0: Setting Powered False 10:23:16.505920 bus /gobi_0: Setting Powered False 10:23:17.631190 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_sms:trx-b200 --------------------------------------------------------------------- 10:23:18.865436 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:18.869271 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 10:23:18.901980 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 10:23:18.908758 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 10:23:18.960402 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 10:23:18.993227 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 10:23:19.000045 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 10:23:19.541911 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 10:23:19.547304 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 10:23:19.558682 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 10:23:19.609983 tst mo_mt_sms.py: using LAC 33287 10:23:19.738188 tst mo_mt_sms.py: using RAC 137 10:23:19.857317 tst mo_mt_sms.py: using CellId 33287 10:23:19.976940 tst mo_mt_sms.py: using BVCI 33288 10:23:20.088547 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 10:23:20.209727 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 10:23:20.327702 tst mo_mt_sms.py:9: start nitb and bts... 10:23:20.550940 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:23:21.220070 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8320): Launched 10:23:21.551070 run osmo-nitb_10.42.42.2(pid=8321): Launched 10:23:21.732033 run osmo-nitb_10.42.42.2(pid=8321): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8321)] 10:23:21.878330 run osmo-nitb_10.42.42.2(pid=8321): stdout: | (launched: 2022-12-13_10:23:21.489500) 10:23:22.026167 run osmo-nitb_10.42.42.2(pid=8321): stderr: | (launched: 2022-12-13_10:23:21.537992) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:23:22.173897 run osmo-nitb_10.42.42.2(pid=8321): stdout: | (launched: 2022-12-13_10:23:21.489500) 10:23:22.316037 run osmo-nitb_10.42.42.2(pid=8321): stderr: | (launched: 2022-12-13_10:23:21.537992) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8321): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8321) [trial-2388↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8321)] 10:23:22.674689 tst osmo-nitb_10.42.42.2(pid=8321): stdout: | (launched: 2022-12-13_10:23:21.489500) 10:23:22.807821 tst osmo-nitb_10.42.42.2(pid=8321): stderr: | (launched: 2022-12-13_10:23:21.537992) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:23:22.964304 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=8321): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8321) [trial-2388↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8321)] [trial-2388↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 10:23:22.973819 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 10:23:22.981409 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8320): Terminating (SIGTERM) 10:23:23.194268 --- ParallelTerminationStrategy: PID 8320 died... 10:23:23.216590 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8320): Terminated: ok {rc=0} 10:23:23.306932 bus /sierra_3: Setting Powered False 10:23:24.406501 bus /sierra_3: Setting Powered False 10:23:25.524309 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 sms:trx-b200 --------------------------------------------------------------------- 10:23:26.725225 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:26.729465 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 10:23:26.762222 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 10:23:26.789968 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 10:23:26.843972 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 10:23:26.880245 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 10:23:26.908016 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 10:23:27.451807 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 10:23:27.457511 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:23:27.468660 tst sms:trx-b200: Using 1 x bts (candidates: 1) 10:23:27.519098 tst mo_mt_sms.py: using LAC 33288 10:23:27.640146 tst mo_mt_sms.py: using RAC 138 10:23:27.769097 tst mo_mt_sms.py: using CellId 33288 10:23:27.898616 tst mo_mt_sms.py: using BVCI 33289 10:23:28.016819 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:23:28.028130 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:23:28.039322 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:23:28.050440 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:23:28.061818 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:23:28.073281 tst sms:trx-b200: Using 1 x modem (candidates: 2) 10:23:28.190538 tst sms:trx-b200: Using 1 x modem (candidates: 2) 10:23:28.311337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:28.822433 run create_hlr_db(pid=8325): Launched 10:23:28.949165 bus /sierra_2: Setting Powered False 10:23:30.013962 run create_hlr_db(pid=8325): Terminated: ok {rc=0} 10:23:30.453588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8327): Launched 10:23:30.759571 run osmo-hlr_10.42.42.2(pid=8328): Launched 10:23:30.918471 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:31.667463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8330): Launched 10:23:32.085791 run osmo-stp_10.42.42.5(pid=8331): Launched 10:23:32.308220 run osmo-msc_10.42.42.6: Starting osmo-msc 10:23:32.981489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8333): Launched 10:23:33.288724 run osmo-msc_10.42.42.6(pid=8334): Launched 10:23:33.459719 run osmo-stp_10.42.42.5(pid=8331): ERR: Terminated: ERROR {rc=1} [trial-2388↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8331)] 10:23:33.587914 run osmo-stp_10.42.42.5(pid=8331): stdout: | (launched: 2022-12-13_10:23:32.007770) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:33.717464 run osmo-stp_10.42.42.5(pid=8331): stderr: | 20221213102332363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102332363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102332364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102332364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102332365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102332366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102332366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:33.844695 run osmo-stp_10.42.42.5(pid=8331): stdout: | (launched: 2022-12-13_10:23:32.007770) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:33.966177 run osmo-stp_10.42.42.5(pid=8331): stderr: | 20221213102332363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102332363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102332364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102332364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102332365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102332366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102332366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:34.111922 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8331): Process ended prematurely: osmo-stp_10.42.42.5(pid=8331) [trial-2388↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8331)] [trial-2388↪sms:trx-b200↪mo_mt_sms.py:16] 10:23:34.120227 tst mo_mt_sms.py:16: Test FAILED (6.7 sec) 10:23:34.146286 run osmo-hlr_10.42.42.2(pid=8328): ERR: Terminated: ERROR {rc=237} [trial-2388↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8328)] 10:23:34.194941 run osmo-hlr_10.42.42.2(pid=8328): stdout: | (launched: 2022-12-13_10:23:30.701292) 10:23:34.245340 run osmo-hlr_10.42.42.2(pid=8328): stderr: | 20221213102330924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102330925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102330925 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102330925 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102330925 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102330925 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102330942 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102330963 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102330963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102330963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:34.315412 run osmo-msc_10.42.42.6(pid=8334): ERR: Terminated: ERROR {rc=2} [trial-2388↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8334)] 10:23:34.363843 run osmo-msc_10.42.42.6(pid=8334): stdout: | (launched: 2022-12-13_10:23:33.230770) 10:23:34.414102 run osmo-msc_10.42.42.6(pid=8334): stderr: | 20221213102333505 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102333505 DLGLOBAL DEBUG validating counter group 0x7f2c9c8fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102333505 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102333505 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102333506 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102333506 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102333507 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102333508 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102333508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102333508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:23:34.464356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8327): Terminating (SIGTERM) 10:23:34.504798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8330): Terminating (SIGTERM) 10:23:34.545240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8333): Terminating (SIGTERM) 10:23:34.585804 --- ParallelTerminationStrategy: PID 8327 died... 10:23:34.605346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8327): Terminated: ok {rc=0} 10:23:34.649707 --- ParallelTerminationStrategy: PID 8330 died... 10:23:34.668321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8330): Terminated: ok {rc=0} 10:23:34.712441 --- ParallelTerminationStrategy: PID 8333 died... 10:23:34.731206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8333): Terminated: ok {rc=0} 10:23:34.816019 bus /sierra_3: Setting Powered False 10:23:35.915778 bus /sierra_3: Setting Powered False 10:23:37.034891 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_ussd:trx-b200 --------------------------------------------------------------------- 10:23:38.266888 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:38.272022 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 10:23:38.307288 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 10:23:38.315999 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 10:23:38.352719 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 10:23:38.387251 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 10:23:38.394824 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 10:23:38.913372 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2388 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 10:23:38.918772 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 10:23:38.930286 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 10:23:38.981158 tst assert_extension.py: using LAC 33289 10:23:39.109300 tst assert_extension.py: using RAC 139 10:23:39.228769 tst assert_extension.py: using CellId 33289 10:23:39.346294 tst assert_extension.py: using BVCI 33290 10:23:39.457399 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 10:23:39.578444 tst assert_extension.py:10: start nitb and bts... 10:23:39.797555 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:23:40.459919 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8339): Launched 10:23:40.786535 run osmo-nitb_10.42.42.2(pid=8340): Launched 10:23:40.968656 run osmo-nitb_10.42.42.2(pid=8340): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8340)] 10:23:41.114392 run osmo-nitb_10.42.42.2(pid=8340): stdout: | (launched: 2022-12-13_10:23:40.725189) 10:23:41.261609 run osmo-nitb_10.42.42.2(pid=8340): stderr: | (launched: 2022-12-13_10:23:40.773530) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:23:41.409457 run osmo-nitb_10.42.42.2(pid=8340): stdout: | (launched: 2022-12-13_10:23:40.725189) 10:23:41.551543 run osmo-nitb_10.42.42.2(pid=8340): stderr: | (launched: 2022-12-13_10:23:40.773530) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8340): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8340) [trial-2388↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8340)] 10:23:41.911979 tst osmo-nitb_10.42.42.2(pid=8340): stdout: | (launched: 2022-12-13_10:23:40.725189) 10:23:42.044392 tst osmo-nitb_10.42.42.2(pid=8340): stderr: | (launched: 2022-12-13_10:23:40.773530) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:23:42.200523 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8340): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8340) [trial-2388↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8340)] [trial-2388↪nitb_ussd:trx-b200↪assert_extension.py:12] 10:23:42.209615 tst assert_extension.py:12: Test FAILED (3.3 sec) 10:23:42.216568 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8339): Terminating (SIGTERM) 10:23:42.429030 --- ParallelTerminationStrategy: PID 8339 died... 10:23:42.450710 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8339): Terminated: ok {rc=0} 10:23:42.542335 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 ussd:trx-b200 --------------------------------------------------------------------- 10:23:43.720757 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:43.726125 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 10:23:43.761485 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 10:23:43.789751 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 10:23:43.826723 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 10:23:43.861518 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 10:23:43.889534 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 10:23:44.417550 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2388 ussd:trx-b200 assert_extension.py ---------------------------------------------- 10:23:44.423017 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:23:44.434391 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 10:23:44.483965 tst assert_extension.py: using LAC 33290 10:23:44.611944 tst assert_extension.py: using RAC 140 10:23:44.741449 tst assert_extension.py: using CellId 33290 10:23:44.871154 tst assert_extension.py: using BVCI 33291 10:23:44.989819 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:23:45.001098 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:23:45.012253 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:23:45.023310 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:23:45.034961 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:23:45.046607 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 10:23:45.164050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:45.638619 run create_hlr_db(pid=8344): Launched 10:23:45.766659 bus /sierra_2: Setting Powered False 10:23:46.833457 run create_hlr_db(pid=8344): Terminated: ok {rc=0} 10:23:47.324507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8382): Launched 10:23:47.653790 run osmo-hlr_10.42.42.2(pid=8383): Launched 10:23:47.907287 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:48.693739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8467): Launched 10:23:49.101050 run osmo-stp_10.42.42.5(pid=8518): Launched 10:23:49.375353 run osmo-msc_10.42.42.6: Starting osmo-msc 10:23:50.153664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8622): Launched 10:23:50.473772 run osmo-msc_10.42.42.6(pid=8623): Launched 10:23:50.826227 run osmo-stp_10.42.42.5(pid=8518): ERR: Terminated: ERROR {rc=1} [trial-2388↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8518)] 10:23:51.093720 run osmo-stp_10.42.42.5(pid=8518): stdout: | (launched: 2022-12-13_10:23:49.021215) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:51.366828 run osmo-stp_10.42.42.5(pid=8518): stderr: | 20221213102349347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102349347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102349347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102349348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102349348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102349348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102349348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:51.527428 run osmo-stp_10.42.42.5(pid=8518): stdout: | (launched: 2022-12-13_10:23:49.021215) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:51.652901 run osmo-stp_10.42.42.5(pid=8518): stderr: | 20221213102349347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102349347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102349347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102349348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102349348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102349348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102349348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:51.802126 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8518): Process ended prematurely: osmo-stp_10.42.42.5(pid=8518) [trial-2388↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8518)] [trial-2388↪ussd:trx-b200↪assert_extension.py:17] 10:23:51.811001 tst assert_extension.py:17: Test FAILED (7.4 sec) 10:23:51.838352 run osmo-hlr_10.42.42.2(pid=8383): ERR: Terminated: ERROR {rc=237} [trial-2388↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8383)] 10:23:51.889283 run osmo-hlr_10.42.42.2(pid=8383): stdout: | (launched: 2022-12-13_10:23:47.594033) 10:23:51.941365 run osmo-hlr_10.42.42.2(pid=8383): stderr: | 20221213102347945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102347945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102347946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102347946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102347946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102347946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102347967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102347984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102347984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102347985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:52.013738 run osmo-msc_10.42.42.6(pid=8623): ERR: Terminated: ERROR {rc=2} [trial-2388↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8623)] 10:23:52.063894 run osmo-msc_10.42.42.6(pid=8623): stdout: | (launched: 2022-12-13_10:23:50.412927) 10:23:52.115755 run osmo-msc_10.42.42.6(pid=8623): stderr: | 20221213102351000 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102351000 DLGLOBAL DEBUG validating counter group 0x7ff804814c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102351000 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102351000 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102351000 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102351000 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102351006 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102351007 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102351007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102351007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:23:52.167431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8382): Terminating (SIGTERM) 10:23:52.210076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8467): Terminating (SIGTERM) 10:23:52.254898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8622): Terminating (SIGTERM) 10:23:52.299554 --- ParallelTerminationStrategy: PID 8382 died... 10:23:52.319961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8382): Terminated: ok {rc=0} 10:23:52.367551 --- ParallelTerminationStrategy: PID 8467 died... 10:23:52.387689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8467): Terminated: ok {rc=0} 10:23:52.433843 --- ParallelTerminationStrategy: PID 8622 died... 10:23:52.453892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8622): Terminated: ok {rc=0} 10:23:52.543675 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:23:53.757555 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:53.764890 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:23:53.799760 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:23:53.828073 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:23:53.877555 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:23:53.910991 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:23:53.939335 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:23:54.491260 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:23:54.545484 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:23:54.557601 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:23:54.634074 tst mo_mt_call.py: using LAC 33291 10:23:54.761594 tst mo_mt_call.py: using RAC 141 10:23:54.885902 tst mo_mt_call.py: using CellId 33291 10:23:55.009363 tst mo_mt_call.py: using BVCI 33292 10:23:55.126771 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:23:55.139080 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:23:55.151004 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:23:55.163117 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:23:55.176221 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:23:55.189156 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:23:55.314250 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:23:55.437950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:55.935233 run create_hlr_db(pid=8630): Launched 10:23:56.102301 bus /sierra_2: Setting Powered False 10:23:57.164136 run create_hlr_db(pid=8630): Terminated: ok {rc=0} 10:23:57.613748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8632): Launched 10:23:57.949258 run osmo-hlr_10.42.42.2(pid=8633): Launched 10:23:58.188463 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:58.914584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8635): Launched 10:23:59.250025 run osmo-stp_10.42.42.5(pid=8636): Launched 10:23:59.505393 run osmo-msc_10.42.42.6: Starting osmo-msc 10:24:00.217734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8638): Launched 10:24:00.553095 run osmo-msc_10.42.42.6(pid=8639): Launched 10:24:00.925245 run osmo-stp_10.42.42.5(pid=8636): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8636)] 10:24:01.176692 run osmo-stp_10.42.42.5(pid=8636): stdout: | (launched: 2022-12-13_10:23:59.187991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:01.334711 run osmo-stp_10.42.42.5(pid=8636): stderr: | 20221213102359515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102359516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102359516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102359516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102359521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102359521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102359521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:01.523641 run osmo-stp_10.42.42.5(pid=8636): stdout: | (launched: 2022-12-13_10:23:59.187991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:01.669928 run osmo-stp_10.42.42.5(pid=8636): stderr: | 20221213102359515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102359516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102359516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102359516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102359521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102359521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102359521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:01.824669 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8636): Process ended prematurely: osmo-stp_10.42.42.5(pid=8636) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8636)] [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:24:01.834424 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 10:24:01.862256 run osmo-hlr_10.42.42.2(pid=8633): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8633)] 10:24:01.912941 run osmo-hlr_10.42.42.2(pid=8633): stdout: | (launched: 2022-12-13_10:23:57.889102) 10:24:01.965165 run osmo-hlr_10.42.42.2(pid=8633): stderr: | 20221213102358227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102358227 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102358227 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102358227 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102358227 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102358227 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102358246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102358254 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102358254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102358254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:02.037994 run osmo-msc_10.42.42.6(pid=8639): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8639)] 10:24:02.087862 run osmo-msc_10.42.42.6(pid=8639): stdout: | (launched: 2022-12-13_10:24:00.492618) 10:24:02.139451 run osmo-msc_10.42.42.6(pid=8639): stderr: | 20221213102401093 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102401093 DLGLOBAL DEBUG validating counter group 0x7f688cfeec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102401094 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102401094 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102401094 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102401094 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102401096 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102401096 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102401096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102401096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:24:02.191574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8632): Terminating (SIGTERM) 10:24:02.234948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8635): Terminating (SIGTERM) 10:24:02.278843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8638): Terminating (SIGTERM) 10:24:02.323066 --- ParallelTerminationStrategy: PID 8632 died... 10:24:02.343660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8632): Terminated: ok {rc=0} 10:24:02.391056 --- ParallelTerminationStrategy: PID 8635 died... 10:24:02.411644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8635): Terminated: ok {rc=0} 10:24:02.457568 --- ParallelTerminationStrategy: PID 8638 died... 10:24:02.477395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8638): Terminated: ok {rc=0} 10:24:02.579872 bus /sierra_3: Setting Powered False 10:24:03.704220 bus /sierra_3: Setting Powered False 10:24:04.828534 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:24:05.989449 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:06.002961 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:24:06.079027 tst mo_mt_call_osmux.py: using LAC 33292 10:24:06.215223 tst mo_mt_call_osmux.py: using RAC 142 10:24:06.349298 tst mo_mt_call_osmux.py: using CellId 33292 10:24:06.485663 tst mo_mt_call_osmux.py: using BVCI 33293 10:24:06.612720 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:06.625693 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:06.638247 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:06.651012 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:06.665698 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:06.679136 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:24:06.810097 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:24:06.941142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:07.478003 run create_hlr_db(pid=8641): Launched 10:24:07.649433 bus /sierra_2: Setting Powered False 10:24:08.717123 run create_hlr_db(pid=8641): Terminated: ok {rc=0} 10:24:09.198651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8643): Launched 10:24:09.558025 run osmo-hlr_10.42.42.2(pid=8644): Launched 10:24:09.796883 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:10.516422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8646): Launched 10:24:10.847713 run osmo-stp_10.42.42.5(pid=8647): Launched 10:24:11.094895 run osmo-msc_10.42.42.6: Starting osmo-msc 10:24:11.804776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8649): Launched 10:24:12.116754 run osmo-msc_10.42.42.6(pid=8650): Launched 10:24:12.289952 run osmo-stp_10.42.42.5(pid=8647): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8647)] 10:24:12.420752 run osmo-stp_10.42.42.5(pid=8647): stdout: | (launched: 2022-12-13_10:24:10.787313) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:12.551784 run osmo-stp_10.42.42.5(pid=8647): stderr: | 20221213102411116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102411116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102411116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102411117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102411117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102411117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102411117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:12.680580 run osmo-stp_10.42.42.5(pid=8647): stdout: | (launched: 2022-12-13_10:24:10.787313) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:12.803630 run osmo-stp_10.42.42.5(pid=8647): stderr: | 20221213102411116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102411116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102411116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102411117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102411117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102411117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102411117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:12.950675 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8647): Process ended prematurely: osmo-stp_10.42.42.5(pid=8647) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8647)] [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:24:12.959569 tst mo_mt_call_osmux.py:8: Test FAILED (7.0 sec) 10:24:12.985968 run osmo-hlr_10.42.42.2(pid=8644): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8644)] 10:24:13.034037 run osmo-hlr_10.42.42.2(pid=8644): stdout: | (launched: 2022-12-13_10:24:09.493541) 10:24:13.083849 run osmo-hlr_10.42.42.2(pid=8644): stderr: | 20221213102409827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102409827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102409827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102409828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102409828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102409828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102409846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102409854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102409855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102409855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:13.153099 run osmo-msc_10.42.42.6(pid=8650): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8650)] 10:24:13.201709 run osmo-msc_10.42.42.6(pid=8650): stdout: | (launched: 2022-12-13_10:24:12.057970) 10:24:13.251334 run osmo-msc_10.42.42.6(pid=8650): stderr: | 20221213102412329 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102412329 DLGLOBAL DEBUG validating counter group 0x7fd207e6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102412329 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102412329 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102412329 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102412329 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102412331 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102412331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102412332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102412332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:24:13.301340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8643): Terminating (SIGTERM) 10:24:13.341450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8646): Terminating (SIGTERM) 10:24:13.381605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8649): Terminating (SIGTERM) 10:24:13.421773 --- ParallelTerminationStrategy: PID 8643 died... 10:24:13.441197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8643): Terminated: ok {rc=0} 10:24:13.485471 --- ParallelTerminationStrategy: PID 8646 died... 10:24:13.504149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8646): Terminated: ok {rc=0} 10:24:13.547828 --- ParallelTerminationStrategy: PID 8649 died... 10:24:13.566539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8649): Terminated: ok {rc=0} 10:24:13.653526 bus /sierra_3: Setting Powered False 10:24:14.754573 bus /sierra_3: Setting Powered False 10:24:15.877706 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:24:17.149566 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:24:17.160936 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:24:17.208671 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:24:17.238026 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:24:17.293712 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:24:17.329618 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:24:17.357342 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:24:17.907025 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:24:17.960237 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:17.971879 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:24:18.043076 tst mo_mt_call.py: using LAC 33293 10:24:18.173841 tst mo_mt_call.py: using RAC 143 10:24:18.303032 tst mo_mt_call.py: using CellId 33293 10:24:18.434219 tst mo_mt_call.py: using BVCI 33294 10:24:18.556061 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:18.567643 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:18.579115 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:18.590585 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:18.602354 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:18.614033 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:24:18.734771 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:24:18.855611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:19.376381 run create_hlr_db(pid=8655): Launched 10:24:19.505311 bus /sierra_2: Setting Powered False 10:24:20.571212 run create_hlr_db(pid=8655): Terminated: ok {rc=0} 10:24:21.017976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8657): Launched 10:24:21.332507 run osmo-hlr_10.42.42.2(pid=8658): Launched 10:24:21.451378 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:22.001228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8660): Launched 10:24:22.315050 run osmo-stp_10.42.42.5(pid=8661): Launched 10:24:22.435365 run osmo-msc_10.42.42.6: Starting osmo-msc 10:24:22.996438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8663): Launched 10:24:23.311056 run osmo-msc_10.42.42.6(pid=8664): Launched 10:24:23.484124 run osmo-stp_10.42.42.5(pid=8661): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8661)] 10:24:23.614158 run osmo-stp_10.42.42.5(pid=8661): stdout: | (launched: 2022-12-13_10:24:22.255649) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:23.744841 run osmo-stp_10.42.42.5(pid=8661): stderr: | 20221213102422428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102422428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102422429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102422429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102422429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102422430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102422430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:23.873742 run osmo-stp_10.42.42.5(pid=8661): stdout: | (launched: 2022-12-13_10:24:22.255649) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:23.997256 run osmo-stp_10.42.42.5(pid=8661): stderr: | 20221213102422428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102422428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102422429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102422429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102422429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102422430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102422430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:24.144898 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8661): Process ended prematurely: osmo-stp_10.42.42.5(pid=8661) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8661)] [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:24:24.154141 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:24:24.180679 run osmo-hlr_10.42.42.2(pid=8658): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8658)] 10:24:24.229424 run osmo-hlr_10.42.42.2(pid=8658): stdout: | (launched: 2022-12-13_10:24:21.273797) 10:24:24.279622 run osmo-hlr_10.42.42.2(pid=8658): stderr: | 20221213102421450 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102421450 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102421450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102421450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102421450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102421451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102421463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102421471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102421472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102421472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:24.349438 run osmo-msc_10.42.42.6(pid=8664): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8664)] 10:24:24.397847 run osmo-msc_10.42.42.6(pid=8664): stdout: | (launched: 2022-12-13_10:24:23.251554) 10:24:24.448012 run osmo-msc_10.42.42.6(pid=8664): stderr: | 20221213102423524 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102423524 DLGLOBAL DEBUG validating counter group 0x7f6b9844bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102423524 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102423524 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102423525 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102423525 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102423527 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102423527 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102423527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102423527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:24:24.498342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8657): Terminating (SIGTERM) 10:24:24.539060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8660): Terminating (SIGTERM) 10:24:24.579505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8663): Terminating (SIGTERM) 10:24:24.620311 --- ParallelTerminationStrategy: PID 8657 died... 10:24:24.640035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8657): Terminated: ok {rc=0} 10:24:24.684896 --- ParallelTerminationStrategy: PID 8660 died... 10:24:24.704554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8660): Terminated: ok {rc=0} 10:24:24.749580 --- ParallelTerminationStrategy: PID 8663 died... 10:24:24.768692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8663): Terminated: ok {rc=0} 10:24:24.856855 bus /sierra_3: Setting Powered False 10:24:25.957737 bus /sierra_3: Setting Powered False 10:24:27.074228 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:24:28.223016 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:28.234868 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:24:28.303727 tst mo_mt_call_osmux.py: using LAC 33294 10:24:28.425596 tst mo_mt_call_osmux.py: using RAC 144 10:24:28.550103 tst mo_mt_call_osmux.py: using CellId 33294 10:24:28.674902 tst mo_mt_call_osmux.py: using BVCI 33295 10:24:28.789443 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:28.800486 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:28.811644 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:28.822680 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:28.833737 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:28.844602 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:24:28.962314 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:24:29.086219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:29.571331 run create_hlr_db(pid=8666): Launched 10:24:29.699002 bus /sierra_2: Setting Powered False 10:24:30.760408 run create_hlr_db(pid=8666): Terminated: ok {rc=0} 10:24:31.246114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8668): Launched 10:24:31.598459 run osmo-hlr_10.42.42.2(pid=8669): Launched 10:24:31.854270 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:32.562720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8671): Launched 10:24:32.876412 run osmo-stp_10.42.42.5(pid=8672): Launched 10:24:32.994857 run osmo-msc_10.42.42.6: Starting osmo-msc 10:24:33.562584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8674): Launched 10:24:33.875402 run osmo-msc_10.42.42.6(pid=8675): Launched 10:24:34.050451 run osmo-stp_10.42.42.5(pid=8672): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8672)] 10:24:34.181223 run osmo-stp_10.42.42.5(pid=8672): stdout: | (launched: 2022-12-13_10:24:32.817477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:34.311253 run osmo-stp_10.42.42.5(pid=8672): stderr: | 20221213102432988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102432988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102432988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102432989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102432989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102432989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102432989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:34.440053 run osmo-stp_10.42.42.5(pid=8672): stdout: | (launched: 2022-12-13_10:24:32.817477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:34.563448 run osmo-stp_10.42.42.5(pid=8672): stderr: | 20221213102432988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102432988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102432988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102432989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102432989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102432989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102432989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:34.711563 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8672): Process ended prematurely: osmo-stp_10.42.42.5(pid=8672) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8672)] [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:24:34.720615 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:24:34.747024 run osmo-hlr_10.42.42.2(pid=8669): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8669)] 10:24:34.794978 run osmo-hlr_10.42.42.2(pid=8669): stdout: | (launched: 2022-12-13_10:24:31.538610) 10:24:34.845123 run osmo-hlr_10.42.42.2(pid=8669): stderr: | 20221213102431807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102431807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102431807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102431807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102431807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102431807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102431822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102431840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102431841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102431841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:34.914503 run osmo-msc_10.42.42.6(pid=8675): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8675)] 10:24:34.962607 run osmo-msc_10.42.42.6(pid=8675): stdout: | (launched: 2022-12-13_10:24:33.816068) 10:24:35.012383 run osmo-msc_10.42.42.6(pid=8675): stderr: | 20221213102434088 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102434088 DLGLOBAL DEBUG validating counter group 0x7f29ee3b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102434088 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102434088 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102434088 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102434088 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102434090 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102434091 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102434091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102434091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:24:35.062678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8668): Terminating (SIGTERM) 10:24:35.102314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8671): Terminating (SIGTERM) 10:24:35.143403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8674): Terminating (SIGTERM) 10:24:35.183319 --- ParallelTerminationStrategy: PID 8668 died... 10:24:35.202711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8668): Terminated: ok {rc=0} 10:24:35.247015 --- ParallelTerminationStrategy: PID 8671 died... 10:24:35.265611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8671): Terminated: ok {rc=0} 10:24:35.309564 --- ParallelTerminationStrategy: PID 8674 died... 10:24:35.328308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8674): Terminated: ok {rc=0} 10:24:35.415865 bus /sierra_3: Setting Powered False 10:24:36.517341 bus /sierra_3: Setting Powered False 10:24:37.635827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:24:38.888437 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:24:38.895120 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:24:38.927876 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:24:38.954875 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:24:39.007852 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:24:39.041334 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:24:39.069033 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:24:39.615895 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:24:39.667163 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:24:39.678563 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:24:39.748633 tst mo_mt_call.py: using LAC 33295 10:24:39.872423 tst mo_mt_call.py: using RAC 145 10:24:39.996475 tst mo_mt_call.py: using CellId 33295 10:24:40.118204 tst mo_mt_call.py: using BVCI 33296 10:24:40.233152 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:24:40.244933 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:24:40.256079 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:24:40.267199 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:24:40.278887 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:24:40.290653 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:24:40.415824 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:24:40.536014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:41.021084 run create_hlr_db(pid=8681): Launched 10:24:41.148005 bus /sierra_2: Setting Powered False 10:24:42.213359 run create_hlr_db(pid=8681): Terminated: ok {rc=0} 10:24:42.680683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8683): Launched 10:24:43.016829 run osmo-hlr_10.42.42.2(pid=8684): Launched 10:24:43.144776 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:43.725243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8686): Launched 10:24:44.061408 run osmo-stp_10.42.42.5(pid=8687): Launched 10:24:44.189954 run osmo-msc_10.42.42.6: Starting osmo-msc 10:24:44.795767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8689): Launched 10:24:45.132041 run osmo-msc_10.42.42.6(pid=8690): Launched 10:24:45.319087 run osmo-stp_10.42.42.5(pid=8687): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8687)] 10:24:45.463105 run osmo-stp_10.42.42.5(pid=8687): stdout: | (launched: 2022-12-13_10:24:43.998671) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:45.604764 run osmo-stp_10.42.42.5(pid=8687): stderr: | 20221213102444187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102444188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102444188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102444188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102444189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102444189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102444189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:45.743899 run osmo-stp_10.42.42.5(pid=8687): stdout: | (launched: 2022-12-13_10:24:43.998671) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:45.892086 run osmo-stp_10.42.42.5(pid=8687): stderr: | 20221213102444187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102444188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102444188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102444188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102444189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102444189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102444189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:46.051272 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8687): Process ended prematurely: osmo-stp_10.42.42.5(pid=8687) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8687)] [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:24:46.061532 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:24:46.089785 run osmo-hlr_10.42.42.2(pid=8684): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8684)] 10:24:46.140029 run osmo-hlr_10.42.42.2(pid=8684): stdout: | (launched: 2022-12-13_10:24:42.954453) 10:24:46.192367 run osmo-hlr_10.42.42.2(pid=8684): stderr: | 20221213102443151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102443151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102443151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102443151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102443151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102443151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102443163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102443172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102443172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102443172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:46.266085 run osmo-msc_10.42.42.6(pid=8690): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8690)] 10:24:46.316004 run osmo-msc_10.42.42.6(pid=8690): stdout: | (launched: 2022-12-13_10:24:45.069243) 10:24:46.368210 run osmo-msc_10.42.42.6(pid=8690): stderr: | 20221213102445391 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102445391 DLGLOBAL DEBUG validating counter group 0x7fd53d774c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102445391 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102445391 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102445392 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102445392 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102445393 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102445394 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102445394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102445394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:24:46.422339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8683): Terminating (SIGTERM) 10:24:46.464648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8686): Terminating (SIGTERM) 10:24:46.508718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8689): Terminating (SIGTERM) 10:24:46.553460 --- ParallelTerminationStrategy: PID 8683 died... 10:24:46.573992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8683): Terminated: ok {rc=0} 10:24:46.622474 --- ParallelTerminationStrategy: PID 8686 died... 10:24:46.642318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8686): Terminated: ok {rc=0} 10:24:46.688902 --- ParallelTerminationStrategy: PID 8689 died... 10:24:46.708715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8689): Terminated: ok {rc=0} 10:24:46.804089 bus /sierra_3: Setting Powered False 10:24:47.907734 bus /sierra_3: Setting Powered False 10:24:49.029226 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:24:50.178578 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:24:50.190740 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:24:50.260913 tst mo_mt_call_osmux.py: using LAC 33296 10:24:50.384648 tst mo_mt_call_osmux.py: using RAC 146 10:24:50.506578 tst mo_mt_call_osmux.py: using CellId 33296 10:24:50.638521 tst mo_mt_call_osmux.py: using BVCI 33297 10:24:50.760766 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:24:50.772551 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:24:50.784062 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:24:50.795499 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:24:50.807262 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:24:50.819084 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:24:50.937903 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:24:51.060227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:51.578339 run create_hlr_db(pid=8692): Launched 10:24:51.705566 bus /sierra_2: Setting Powered False 10:24:52.771283 run create_hlr_db(pid=8692): Terminated: ok {rc=0} 10:24:53.236314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8694): Launched 10:24:53.571333 run osmo-hlr_10.42.42.2(pid=8695): Launched 10:24:53.700626 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:54.278086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8697): Launched 10:24:54.613688 run osmo-stp_10.42.42.5(pid=8698): Launched 10:24:54.742170 run osmo-msc_10.42.42.6: Starting osmo-msc 10:24:55.347216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8700): Launched 10:24:55.684331 run osmo-msc_10.42.42.6(pid=8701): Launched 10:24:55.870792 run osmo-stp_10.42.42.5(pid=8698): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8698)] 10:24:56.011215 run osmo-stp_10.42.42.5(pid=8698): stdout: | (launched: 2022-12-13_10:24:54.551022) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:56.152264 run osmo-stp_10.42.42.5(pid=8698): stderr: | 20221213102454742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102454742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102454742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102454743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102454743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102454743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102454743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:56.290671 run osmo-stp_10.42.42.5(pid=8698): stdout: | (launched: 2022-12-13_10:24:54.551022) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:56.423723 run osmo-stp_10.42.42.5(pid=8698): stderr: | 20221213102454742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102454742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102454742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102454743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102454743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102454743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102454743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:56.583347 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8698): Process ended prematurely: osmo-stp_10.42.42.5(pid=8698) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8698)] [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:24:56.593092 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:24:56.621330 run osmo-hlr_10.42.42.2(pid=8695): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8695)] 10:24:56.672674 run osmo-hlr_10.42.42.2(pid=8695): stdout: | (launched: 2022-12-13_10:24:53.508340) 10:24:56.725528 run osmo-hlr_10.42.42.2(pid=8695): stderr: | 20221213102453706 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102453706 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102453706 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102453706 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102453706 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102453706 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102453718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102453729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102453729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102453729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:56.799372 run osmo-msc_10.42.42.6(pid=8701): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8701)] 10:24:56.850251 run osmo-msc_10.42.42.6(pid=8701): stdout: | (launched: 2022-12-13_10:24:55.621483) 10:24:56.903535 run osmo-msc_10.42.42.6(pid=8701): stderr: | 20221213102455943 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102455943 DLGLOBAL DEBUG validating counter group 0x7fbb255e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102455943 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102455943 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102455943 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102455944 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102455946 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102455946 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102455946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102455946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:24:56.956233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8694): Terminating (SIGTERM) 10:24:56.998973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8697): Terminating (SIGTERM) 10:24:57.041529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8700): Terminating (SIGTERM) 10:24:57.084092 --- ParallelTerminationStrategy: PID 8694 died... 10:24:57.104743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8694): Terminated: ok {rc=0} 10:24:57.151668 --- ParallelTerminationStrategy: PID 8697 died... 10:24:57.171606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8697): Terminated: ok {rc=0} 10:24:57.218130 --- ParallelTerminationStrategy: PID 8700 died... 10:24:57.238131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8700): Terminated: ok {rc=0} 10:24:57.327180 bus /sierra_3: Setting Powered False 10:24:58.425999 bus /sierra_3: Setting Powered False 10:24:59.542917 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:25:00.792663 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:25:00.799396 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:25:00.832828 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:25:00.861124 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:25:00.922761 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:25:00.970426 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:25:01.002236 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:25:01.555995 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:25:01.612140 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:01.625407 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:25:01.695816 tst mo_mt_call.py: using LAC 33297 10:25:01.829139 tst mo_mt_call.py: using RAC 147 10:25:02.018452 tst mo_mt_call.py: using CellId 33297 10:25:02.142237 tst mo_mt_call.py: using BVCI 33298 10:25:02.299213 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:02.315939 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:02.332256 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:02.349588 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:02.362791 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:02.376764 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:25:02.498761 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:25:02.621633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:03.141600 run create_hlr_db(pid=8709): Launched 10:25:03.268865 bus /sierra_2: Setting Powered False 10:25:04.333416 run create_hlr_db(pid=8709): Terminated: ok {rc=0} 10:25:04.800046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8711): Launched 10:25:05.136326 run osmo-hlr_10.42.42.2(pid=8712): Launched 10:25:05.264869 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:05.843722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8714): Launched 10:25:06.178566 run osmo-stp_10.42.42.5(pid=8715): Launched 10:25:06.305251 run osmo-msc_10.42.42.6: Starting osmo-msc 10:25:06.913603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8717): Launched 10:25:07.249769 run osmo-msc_10.42.42.6(pid=8718): Launched 10:25:07.435961 run osmo-stp_10.42.42.5(pid=8715): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8715)] 10:25:07.577819 run osmo-stp_10.42.42.5(pid=8715): stdout: | (launched: 2022-12-13_10:25:06.115730) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:07.719336 run osmo-stp_10.42.42.5(pid=8715): stderr: | 20221213102506308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102506308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102506308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102506308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102506309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102506309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102506309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:07.858569 run osmo-stp_10.42.42.5(pid=8715): stdout: | (launched: 2022-12-13_10:25:06.115730) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:07.991446 run osmo-stp_10.42.42.5(pid=8715): stderr: | 20221213102506308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102506308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102506308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102506308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102506309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102506309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102506309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:08.150902 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8715): Process ended prematurely: osmo-stp_10.42.42.5(pid=8715) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8715)] [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:25:08.160515 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:25:08.188365 run osmo-hlr_10.42.42.2(pid=8712): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8712)] 10:25:08.239590 run osmo-hlr_10.42.42.2(pid=8712): stdout: | (launched: 2022-12-13_10:25:05.073554) 10:25:08.292496 run osmo-hlr_10.42.42.2(pid=8712): stderr: | 20221213102505271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102505272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102505272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102505272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102505272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102505272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102505284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102505292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102505293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102505293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:08.365387 run osmo-msc_10.42.42.6(pid=8718): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8718)] 10:25:08.415503 run osmo-msc_10.42.42.6(pid=8718): stdout: | (launched: 2022-12-13_10:25:07.187179) 10:25:08.468283 run osmo-msc_10.42.42.6(pid=8718): stderr: | 20221213102507509 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102507509 DLGLOBAL DEBUG validating counter group 0x7ff7515a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102507509 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102507509 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102507509 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102507510 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102507511 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102507512 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102507512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102507512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:25:08.521030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8711): Terminating (SIGTERM) 10:25:08.563450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8714): Terminating (SIGTERM) 10:25:08.606710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8717): Terminating (SIGTERM) 10:25:08.649279 --- ParallelTerminationStrategy: PID 8711 died... 10:25:08.669720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8711): Terminated: ok {rc=0} 10:25:08.716547 --- ParallelTerminationStrategy: PID 8714 died... 10:25:08.736578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8714): Terminated: ok {rc=0} 10:25:08.783776 --- ParallelTerminationStrategy: PID 8717 died... 10:25:08.803869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8717): Terminated: ok {rc=0} 10:25:08.893134 bus /sierra_3: Setting Powered False 10:25:09.991913 bus /sierra_3: Setting Powered False 10:25:11.109380 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:25:12.262429 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:12.274974 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:25:12.347005 tst mo_mt_call_osmux.py: using LAC 33298 10:25:12.479491 tst mo_mt_call_osmux.py: using RAC 148 10:25:12.610914 tst mo_mt_call_osmux.py: using CellId 33298 10:25:12.741952 tst mo_mt_call_osmux.py: using BVCI 33299 10:25:12.862733 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:12.874344 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:12.885811 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:12.897248 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:12.908906 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:12.920650 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:25:13.044221 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:25:13.170250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:13.690579 run create_hlr_db(pid=8721): Launched 10:25:13.818898 bus /sierra_2: Setting Powered False 10:25:14.884172 run create_hlr_db(pid=8721): Terminated: ok {rc=0} 10:25:15.331094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8723): Launched 10:25:15.644149 run osmo-hlr_10.42.42.2(pid=8724): Launched 10:25:15.763123 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:16.372278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8726): Launched 10:25:16.703735 run osmo-stp_10.42.42.5(pid=8727): Launched 10:25:16.945986 run osmo-msc_10.42.42.6: Starting osmo-msc 10:25:17.551113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8729): Launched 10:25:17.866272 run osmo-msc_10.42.42.6(pid=8730): Launched 10:25:18.041795 run osmo-stp_10.42.42.5(pid=8727): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8727)] 10:25:18.172703 run osmo-stp_10.42.42.5(pid=8727): stdout: | (launched: 2022-12-13_10:25:16.643501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:18.303632 run osmo-stp_10.42.42.5(pid=8727): stderr: | 20221213102516967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102516967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102516967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102516968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102516968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102516968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102516968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:18.432406 run osmo-stp_10.42.42.5(pid=8727): stdout: | (launched: 2022-12-13_10:25:16.643501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:18.555907 run osmo-stp_10.42.42.5(pid=8727): stderr: | 20221213102516967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102516967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102516967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102516968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102516968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102516968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102516968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:18.703976 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8727): Process ended prematurely: osmo-stp_10.42.42.5(pid=8727) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8727)] [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:25:18.712939 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:25:18.739241 run osmo-hlr_10.42.42.2(pid=8724): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8724)] 10:25:18.787385 run osmo-hlr_10.42.42.2(pid=8724): stdout: | (launched: 2022-12-13_10:25:15.585541) 10:25:18.837324 run osmo-hlr_10.42.42.2(pid=8724): stderr: | 20221213102515760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102515760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102515760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102515761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102515761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102515761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102515773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102515781 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102515781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102515781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:18.907223 run osmo-msc_10.42.42.6(pid=8730): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8730)] 10:25:18.955596 run osmo-msc_10.42.42.6(pid=8730): stdout: | (launched: 2022-12-13_10:25:17.807158) 10:25:19.005435 run osmo-msc_10.42.42.6(pid=8730): stderr: | 20221213102518079 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102518079 DLGLOBAL DEBUG validating counter group 0x7fe6fa1bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102518079 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102518079 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102518079 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102518079 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102518081 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102518082 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102518082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102518082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:25:19.055423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8723): Terminating (SIGTERM) 10:25:19.095593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8726): Terminating (SIGTERM) 10:25:19.135753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8729): Terminating (SIGTERM) 10:25:19.176161 --- ParallelTerminationStrategy: PID 8723 died... 10:25:19.195779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8723): Terminated: ok {rc=0} 10:25:19.240542 --- ParallelTerminationStrategy: PID 8726 died... 10:25:19.259370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8726): Terminated: ok {rc=0} 10:25:19.303693 --- ParallelTerminationStrategy: PID 8729 died... 10:25:19.322415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8729): Terminated: ok {rc=0} 10:25:19.408526 bus /sierra_3: Setting Powered False 10:25:20.511615 bus /sierra_3: Setting Powered False 10:25:21.630904 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:25:22.886929 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:25:22.894050 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:25:22.927971 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:25:22.957520 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:25:23.014743 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:25:23.050449 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:25:23.078525 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:25:23.623808 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:25:23.679471 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:23.691136 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:25:23.763479 tst mo_mt_call.py: using LAC 33299 10:25:23.895528 tst mo_mt_call.py: using RAC 149 10:25:24.027311 tst mo_mt_call.py: using CellId 33299 10:25:24.151602 tst mo_mt_call.py: using BVCI 33300 10:25:24.265423 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:24.276736 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:24.287843 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:24.298759 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:24.309735 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:24.320563 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:25:24.439091 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:25:24.562064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:25.080087 run create_hlr_db(pid=8735): Launched 10:25:25.208871 bus /sierra_2: Setting Powered False 10:25:26.274983 run create_hlr_db(pid=8735): Terminated: ok {rc=0} 10:25:26.721288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8737): Launched 10:25:27.034233 run osmo-hlr_10.42.42.2(pid=8738): Launched 10:25:27.152053 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:27.686791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8740): Launched 10:25:27.999868 run osmo-stp_10.42.42.5(pid=8741): Launched 10:25:28.119222 run osmo-msc_10.42.42.6: Starting osmo-msc 10:25:28.680790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8743): Launched 10:25:28.994183 run osmo-msc_10.42.42.6(pid=8744): Launched 10:25:29.166237 run osmo-stp_10.42.42.5(pid=8741): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8741)] 10:25:29.295966 run osmo-stp_10.42.42.5(pid=8741): stdout: | (launched: 2022-12-13_10:25:27.940814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:29.426599 run osmo-stp_10.42.42.5(pid=8741): stderr: | 20221213102528111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102528111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102528111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102528112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102528112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102528112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102528112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:29.555824 run osmo-stp_10.42.42.5(pid=8741): stdout: | (launched: 2022-12-13_10:25:27.940814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:29.678998 run osmo-stp_10.42.42.5(pid=8741): stderr: | 20221213102528111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102528111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102528111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102528112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102528112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102528112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102528112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:29.827451 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8741): Process ended prematurely: osmo-stp_10.42.42.5(pid=8741) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8741)] [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:25:29.836630 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:25:29.863254 run osmo-hlr_10.42.42.2(pid=8738): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8738)] 10:25:29.911196 run osmo-hlr_10.42.42.2(pid=8738): stdout: | (launched: 2022-12-13_10:25:26.975363) 10:25:29.961178 run osmo-hlr_10.42.42.2(pid=8738): stderr: | 20221213102527150 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102527150 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102527150 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102527151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102527151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102527151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102527162 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102527170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102527170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102527170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:30.030488 run osmo-msc_10.42.42.6(pid=8744): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8744)] 10:25:30.078582 run osmo-msc_10.42.42.6(pid=8744): stdout: | (launched: 2022-12-13_10:25:28.935087) 10:25:30.128628 run osmo-msc_10.42.42.6(pid=8744): stderr: | 20221213102529208 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102529208 DLGLOBAL DEBUG validating counter group 0x7fe3d57fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102529208 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102529208 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102529209 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102529209 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102529211 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102529211 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102529211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102529211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:25:30.178935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8737): Terminating (SIGTERM) 10:25:30.219079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8740): Terminating (SIGTERM) 10:25:30.259216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8743): Terminating (SIGTERM) 10:25:30.299482 --- ParallelTerminationStrategy: PID 8737 died... 10:25:30.319031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8737): Terminated: ok {rc=0} 10:25:30.363458 --- ParallelTerminationStrategy: PID 8740 died... 10:25:30.382440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8740): Terminated: ok {rc=0} 10:25:30.426855 --- ParallelTerminationStrategy: PID 8743 died... 10:25:30.445712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8743): Terminated: ok {rc=0} 10:25:30.532528 bus /sierra_3: Setting Powered False 10:25:31.634261 bus /sierra_3: Setting Powered False 10:25:32.755550 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:25:33.905441 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:33.917817 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:25:33.991395 tst mo_mt_call_osmux.py: using LAC 33300 10:25:34.113386 tst mo_mt_call_osmux.py: using RAC 150 10:25:34.236152 tst mo_mt_call_osmux.py: using CellId 33300 10:25:34.359332 tst mo_mt_call_osmux.py: using BVCI 33301 10:25:34.473783 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:34.485131 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:34.496029 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:34.506969 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:34.518045 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:34.529008 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:25:34.646315 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:25:34.767925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:35.289661 run create_hlr_db(pid=8746): Launched 10:25:35.416669 bus /sierra_2: Setting Powered False 10:25:36.483238 run create_hlr_db(pid=8746): Terminated: ok {rc=0} 10:25:36.930624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8748): Launched 10:25:37.243584 run osmo-hlr_10.42.42.2(pid=8749): Launched 10:25:37.362875 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:37.898734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8751): Launched 10:25:38.211874 run osmo-stp_10.42.42.5(pid=8752): Launched 10:25:38.331029 run osmo-msc_10.42.42.6: Starting osmo-msc 10:25:38.894309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8754): Launched 10:25:39.206979 run osmo-msc_10.42.42.6(pid=8755): Launched 10:25:39.382336 run osmo-stp_10.42.42.5(pid=8752): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8752)] 10:25:39.512844 run osmo-stp_10.42.42.5(pid=8752): stdout: | (launched: 2022-12-13_10:25:38.152535) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:39.643889 run osmo-stp_10.42.42.5(pid=8752): stderr: | 20221213102538325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102538325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102538325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102538326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102538326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102538326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102538326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:39.773222 run osmo-stp_10.42.42.5(pid=8752): stdout: | (launched: 2022-12-13_10:25:38.152535) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:39.897406 run osmo-stp_10.42.42.5(pid=8752): stderr: | 20221213102538325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102538325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102538325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102538326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102538326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102538326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102538326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:40.046012 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8752): Process ended prematurely: osmo-stp_10.42.42.5(pid=8752) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8752)] [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:25:40.055074 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:25:40.081695 run osmo-hlr_10.42.42.2(pid=8749): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8749)] 10:25:40.129952 run osmo-hlr_10.42.42.2(pid=8749): stdout: | (launched: 2022-12-13_10:25:37.184353) 10:25:40.180162 run osmo-hlr_10.42.42.2(pid=8749): stderr: | 20221213102537361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102537361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102537361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102537361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102537361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102537361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102537374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102537382 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102537382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102537382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:40.249667 run osmo-msc_10.42.42.6(pid=8755): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8755)] 10:25:40.297620 run osmo-msc_10.42.42.6(pid=8755): stdout: | (launched: 2022-12-13_10:25:39.147887) 10:25:40.347137 run osmo-msc_10.42.42.6(pid=8755): stderr: | 20221213102539422 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102539422 DLGLOBAL DEBUG validating counter group 0x7f768bac4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102539422 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102539422 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102539422 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102539423 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102539425 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102539426 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102539426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102539426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:25:40.397608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8748): Terminating (SIGTERM) 10:25:40.437545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8751): Terminating (SIGTERM) 10:25:40.477699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8754): Terminating (SIGTERM) 10:25:40.518182 --- ParallelTerminationStrategy: PID 8748 died... 10:25:40.537889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8748): Terminated: ok {rc=0} 10:25:40.582530 --- ParallelTerminationStrategy: PID 8751 died... 10:25:40.601404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8751): Terminated: ok {rc=0} 10:25:40.645710 --- ParallelTerminationStrategy: PID 8754 died... 10:25:40.664669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8754): Terminated: ok {rc=0} 10:25:40.752003 bus /sierra_3: Setting Powered False 10:25:41.852431 bus /sierra_3: Setting Powered False 10:25:42.968023 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:25:44.218151 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:25:44.224693 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:25:44.258167 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:25:44.285208 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:25:44.336786 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:25:44.369698 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:25:44.395971 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:25:44.954800 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:25:45.005623 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:25:45.016774 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:25:45.086253 tst mo_mt_call.py: using LAC 33301 10:25:45.210465 tst mo_mt_call.py: using RAC 151 10:25:45.341912 tst mo_mt_call.py: using CellId 33301 10:25:45.473107 tst mo_mt_call.py: using BVCI 33302 10:25:45.594786 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:25:45.606465 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:25:45.617942 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:25:45.629381 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:25:45.641188 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:25:45.652862 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:25:45.771268 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:25:45.894168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:46.513419 run create_hlr_db(pid=8760): Launched 10:25:46.678820 bus /sierra_2: Setting Powered False 10:25:47.740394 run create_hlr_db(pid=8760): Terminated: ok {rc=0} 10:25:48.196671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8762): Launched 10:25:48.533029 run osmo-hlr_10.42.42.2(pid=8763): Launched 10:25:48.660701 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:49.236899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8765): Launched 10:25:49.572457 run osmo-stp_10.42.42.5(pid=8766): Launched 10:25:49.700156 run osmo-msc_10.42.42.6: Starting osmo-msc 10:25:50.302841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8768): Launched 10:25:50.638988 run osmo-msc_10.42.42.6(pid=8769): Launched 10:25:50.823365 run osmo-stp_10.42.42.5(pid=8766): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8766)] 10:25:50.963732 run osmo-stp_10.42.42.5(pid=8766): stdout: | (launched: 2022-12-13_10:25:49.510080) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:51.104361 run osmo-stp_10.42.42.5(pid=8766): stderr: | 20221213102549701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102549701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102549701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102549702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102549702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102549702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102549702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:51.242834 run osmo-stp_10.42.42.5(pid=8766): stdout: | (launched: 2022-12-13_10:25:49.510080) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:51.375221 run osmo-stp_10.42.42.5(pid=8766): stderr: | 20221213102549701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102549701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102549701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102549702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102549702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102549702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102549702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:51.534116 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8766): Process ended prematurely: osmo-stp_10.42.42.5(pid=8766) [trial-2388↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8766)] [trial-2388↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:25:51.543706 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:25:51.571677 run osmo-hlr_10.42.42.2(pid=8763): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8763)] 10:25:51.622654 run osmo-hlr_10.42.42.2(pid=8763): stdout: | (launched: 2022-12-13_10:25:48.470315) 10:25:51.675318 run osmo-hlr_10.42.42.2(pid=8763): stderr: | 20221213102548668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102548668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102548668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102548668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102548668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102548668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102548683 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102548692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102548692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102548692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:51.748577 run osmo-msc_10.42.42.6(pid=8769): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8769)] 10:25:51.799075 run osmo-msc_10.42.42.6(pid=8769): stdout: | (launched: 2022-12-13_10:25:50.576165) 10:25:51.855039 run osmo-msc_10.42.42.6(pid=8769): stderr: | 20221213102550899 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102550899 DLGLOBAL DEBUG validating counter group 0x7f4e2658dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102550899 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102550899 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102550899 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102550899 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102550901 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102550902 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102550902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102550902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:25:51.908891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8762): Terminating (SIGTERM) 10:25:51.951139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8765): Terminating (SIGTERM) 10:25:51.993859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8768): Terminating (SIGTERM) 10:25:52.036516 --- ParallelTerminationStrategy: PID 8762 died... 10:25:52.057177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8762): Terminated: ok {rc=0} 10:25:52.104101 --- ParallelTerminationStrategy: PID 8765 died... 10:25:52.124008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8765): Terminated: ok {rc=0} 10:25:52.171023 --- ParallelTerminationStrategy: PID 8768 died... 10:25:52.191092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8768): Terminated: ok {rc=0} 10:25:52.279222 bus /sierra_3: Setting Powered False 10:25:53.379625 bus /sierra_3: Setting Powered False 10:25:54.496860 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:25:55.650891 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:25:55.663404 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:25:55.741382 tst mo_mt_call_osmux.py: using LAC 33302 10:25:55.872786 tst mo_mt_call_osmux.py: using RAC 152 10:25:56.001492 tst mo_mt_call_osmux.py: using CellId 33302 10:25:56.137155 tst mo_mt_call_osmux.py: using BVCI 33303 10:25:56.259102 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:25:56.270917 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:25:56.282473 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:25:56.294017 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:25:56.305949 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:25:56.317875 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:25:56.436014 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:25:56.560161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:57.046958 run create_hlr_db(pid=8775): Launched 10:25:57.175835 bus /sierra_2: Setting Powered False 10:25:58.238201 run create_hlr_db(pid=8775): Terminated: ok {rc=0} 10:25:58.695956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8777): Launched 10:25:59.031948 run osmo-hlr_10.42.42.2(pid=8778): Launched 10:25:59.160252 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:59.737609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8780): Launched 10:26:00.074631 run osmo-stp_10.42.42.5(pid=8781): Launched 10:26:00.203207 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:00.808154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8783): Launched 10:26:01.167384 run osmo-msc_10.42.42.6(pid=8784): Launched 10:26:01.542062 run osmo-stp_10.42.42.5(pid=8781): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8781)] 10:26:01.826654 run osmo-stp_10.42.42.5(pid=8781): stdout: | (launched: 2022-12-13_10:26:00.011194) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:01.996916 run osmo-stp_10.42.42.5(pid=8781): stderr: | 20221213102600202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102600202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102600203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102600203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102600203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102600203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102600204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:02.175614 run osmo-stp_10.42.42.5(pid=8781): stdout: | (launched: 2022-12-13_10:26:00.011194) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:02.308807 run osmo-stp_10.42.42.5(pid=8781): stderr: | 20221213102600202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102600202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102600203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102600203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102600203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102600203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102600204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:02.462331 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8781): Process ended prematurely: osmo-stp_10.42.42.5(pid=8781) [trial-2388↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8781)] [trial-2388↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:26:02.472359 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 10:26:02.500597 run osmo-hlr_10.42.42.2(pid=8778): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8778)] 10:26:02.553452 run osmo-hlr_10.42.42.2(pid=8778): stdout: | (launched: 2022-12-13_10:25:58.968940) 10:26:02.607857 run osmo-hlr_10.42.42.2(pid=8778): stderr: | 20221213102559165 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102559165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102559165 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102559165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102559165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102559165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102559178 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102559187 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102559187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102559187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:02.682719 run osmo-msc_10.42.42.6(pid=8784): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8784)] 10:26:02.733536 run osmo-msc_10.42.42.6(pid=8784): stdout: | (launched: 2022-12-13_10:26:01.104562) 10:26:02.787958 run osmo-msc_10.42.42.6(pid=8784): stderr: | 20221213102601610 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102601610 DLGLOBAL DEBUG validating counter group 0x7f676d042c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102601611 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102601611 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102601611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102601611 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102601613 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102601613 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102601613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102601613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:02.842310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8777): Terminating (SIGTERM) 10:26:02.884467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8780): Terminating (SIGTERM) 10:26:02.927527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8783): Terminating (SIGTERM) 10:26:02.970790 --- ParallelTerminationStrategy: PID 8777 died... 10:26:02.991454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8777): Terminated: ok {rc=0} 10:26:03.038985 --- ParallelTerminationStrategy: PID 8780 died... 10:26:03.059504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8780): Terminated: ok {rc=0} 10:26:03.107078 --- ParallelTerminationStrategy: PID 8783 died... 10:26:03.127758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8783): Terminated: ok {rc=0} 10:26:03.218585 bus /sierra_3: Setting Powered False 10:26:04.318603 bus /sierra_3: Setting Powered False 10:26:05.435925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:26:06.689569 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:26:06.695774 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:26:06.729744 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:26:06.757737 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:26:06.811430 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:26:06.845468 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:26:06.873156 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:26:07.422163 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:26:07.477635 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:07.489128 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:26:07.562018 tst mo_mt_call.py: using LAC 33303 10:26:07.694128 tst mo_mt_call.py: using RAC 153 10:26:07.824614 tst mo_mt_call.py: using CellId 33303 10:26:07.955838 tst mo_mt_call.py: using BVCI 33304 10:26:08.076528 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:08.087989 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:08.099317 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:08.110570 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:08.122341 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:08.133939 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:26:08.252157 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:26:08.374678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:08.894392 run create_hlr_db(pid=8789): Launched 10:26:09.022997 bus /sierra_2: Setting Powered False 10:26:10.088218 run create_hlr_db(pid=8789): Terminated: ok {rc=0} 10:26:10.535078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8791): Launched 10:26:10.849205 run osmo-hlr_10.42.42.2(pid=8792): Launched 10:26:10.968224 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:11.518203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8794): Launched 10:26:11.831649 run osmo-stp_10.42.42.5(pid=8795): Launched 10:26:11.951845 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:12.527308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8797): Launched 10:26:12.842866 run osmo-msc_10.42.42.6(pid=8798): Launched 10:26:13.020157 run osmo-stp_10.42.42.5(pid=8795): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8795)] 10:26:13.151947 run osmo-stp_10.42.42.5(pid=8795): stdout: | (launched: 2022-12-13_10:26:11.772342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:13.283980 run osmo-stp_10.42.42.5(pid=8795): stderr: | 20221213102611944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102611944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102611945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102611945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102611946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102611946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102611946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:13.413406 run osmo-stp_10.42.42.5(pid=8795): stdout: | (launched: 2022-12-13_10:26:11.772342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:13.537337 run osmo-stp_10.42.42.5(pid=8795): stderr: | 20221213102611944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102611944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102611945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102611945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102611946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102611946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102611946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:13.686137 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8795): Process ended prematurely: osmo-stp_10.42.42.5(pid=8795) [trial-2388↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8795)] [trial-2388↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:26:13.695091 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:26:13.721499 run osmo-hlr_10.42.42.2(pid=8792): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8792)] 10:26:13.769900 run osmo-hlr_10.42.42.2(pid=8792): stdout: | (launched: 2022-12-13_10:26:10.790095) 10:26:13.820128 run osmo-hlr_10.42.42.2(pid=8792): stderr: | 20221213102610967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102610967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102610967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102610967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102610967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102610967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102610979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102610988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102610988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102610988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:13.889738 run osmo-msc_10.42.42.6(pid=8798): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8798)] 10:26:13.937760 run osmo-msc_10.42.42.6(pid=8798): stdout: | (launched: 2022-12-13_10:26:12.783220) 10:26:13.987540 run osmo-msc_10.42.42.6(pid=8798): stderr: | 20221213102613056 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102613056 DLGLOBAL DEBUG validating counter group 0x7f4c1050ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102613056 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102613056 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102613057 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102613057 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102613059 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102613059 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102613059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102613059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:14.037776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8791): Terminating (SIGTERM) 10:26:14.077648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8794): Terminating (SIGTERM) 10:26:14.117488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8797): Terminating (SIGTERM) 10:26:14.158031 --- ParallelTerminationStrategy: PID 8791 died... 10:26:14.177700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8791): Terminated: ok {rc=0} 10:26:14.222030 --- ParallelTerminationStrategy: PID 8794 died... 10:26:14.240898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8794): Terminated: ok {rc=0} 10:26:14.285102 --- ParallelTerminationStrategy: PID 8797 died... 10:26:14.303924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8797): Terminated: ok {rc=0} 10:26:14.391459 bus /sierra_3: Setting Powered False 10:26:15.491422 bus /sierra_3: Setting Powered False 10:26:16.617383 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:26:17.794924 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:17.806785 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:26:17.875814 tst mo_mt_call_osmux.py: using LAC 33304 10:26:17.997130 tst mo_mt_call_osmux.py: using RAC 154 10:26:18.118286 tst mo_mt_call_osmux.py: using CellId 33304 10:26:18.239466 tst mo_mt_call_osmux.py: using BVCI 33305 10:26:18.352114 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:18.362991 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:18.373728 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:18.384470 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:18.395274 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:18.406117 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:26:18.531567 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:26:18.654587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:19.174546 run create_hlr_db(pid=8800): Launched 10:26:19.304235 bus /sierra_2: Setting Powered False 10:26:20.365741 run create_hlr_db(pid=8800): Terminated: ok {rc=0} 10:26:20.834362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8802): Launched 10:26:21.170729 run osmo-hlr_10.42.42.2(pid=8803): Launched 10:26:21.298157 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:21.873978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8805): Launched 10:26:22.212188 run osmo-stp_10.42.42.5(pid=8806): Launched 10:26:22.340395 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:22.946609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8808): Launched 10:26:23.282926 run osmo-msc_10.42.42.6(pid=8809): Launched 10:26:23.468245 run osmo-stp_10.42.42.5(pid=8806): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8806)] 10:26:23.609647 run osmo-stp_10.42.42.5(pid=8806): stdout: | (launched: 2022-12-13_10:26:22.149336) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:23.751169 run osmo-stp_10.42.42.5(pid=8806): stderr: | 20221213102622340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102622340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102622340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102622341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102622341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102622341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102622341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:23.890127 run osmo-stp_10.42.42.5(pid=8806): stdout: | (launched: 2022-12-13_10:26:22.149336) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:24.023257 run osmo-stp_10.42.42.5(pid=8806): stderr: | 20221213102622340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102622340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102622340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102622341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102622341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102622341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102622341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:24.183113 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8806): Process ended prematurely: osmo-stp_10.42.42.5(pid=8806) [trial-2388↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8806)] [trial-2388↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:26:24.192614 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:26:24.220746 run osmo-hlr_10.42.42.2(pid=8803): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8803)] 10:26:24.272257 run osmo-hlr_10.42.42.2(pid=8803): stdout: | (launched: 2022-12-13_10:26:21.107664) 10:26:24.325290 run osmo-hlr_10.42.42.2(pid=8803): stderr: | 20221213102621305 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102621305 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102621305 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102621305 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102621305 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102621305 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102621317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102621326 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102621326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102621326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:24.398851 run osmo-msc_10.42.42.6(pid=8809): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8809)] 10:26:24.449682 run osmo-msc_10.42.42.6(pid=8809): stdout: | (launched: 2022-12-13_10:26:23.219730) 10:26:24.502993 run osmo-msc_10.42.42.6(pid=8809): stderr: | 20221213102623542 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102623542 DLGLOBAL DEBUG validating counter group 0x7f96d4603c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102623542 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102623542 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102623542 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102623542 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102623544 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102623544 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102623545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102623545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:24.556126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8802): Terminating (SIGTERM) 10:26:24.598459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8805): Terminating (SIGTERM) 10:26:24.641070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8808): Terminating (SIGTERM) 10:26:24.683847 --- ParallelTerminationStrategy: PID 8802 died... 10:26:24.704557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8802): Terminated: ok {rc=0} 10:26:24.751448 --- ParallelTerminationStrategy: PID 8805 died... 10:26:24.771427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8805): Terminated: ok {rc=0} 10:26:24.818070 --- ParallelTerminationStrategy: PID 8808 died... 10:26:24.838077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8808): Terminated: ok {rc=0} 10:26:24.927418 bus /sierra_3: Setting Powered False 10:26:26.027891 bus /sierra_3: Setting Powered False 10:26:27.145915 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 10:26:28.400610 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:26:28.405771 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 10:26:28.438823 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 10:26:28.465660 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 10:26:28.517110 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 10:26:28.549795 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 10:26:28.576060 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 10:26:29.125655 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 10:26:29.175983 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:26:29.187161 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 10:26:29.237720 tst mo_mt_call.py: using LAC 33305 10:26:29.360822 tst mo_mt_call.py: using RAC 155 10:26:29.484338 tst mo_mt_call.py: using CellId 33305 10:26:29.608531 tst mo_mt_call.py: using BVCI 33306 10:26:29.723564 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:26:29.734690 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:26:29.745550 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:26:29.756238 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:26:29.767504 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:26:29.778942 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:26:29.901623 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:26:30.021585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:30.508116 run create_hlr_db(pid=8814): Launched 10:26:30.636510 bus /sierra_2: Setting Powered False 10:26:31.700905 run create_hlr_db(pid=8814): Terminated: ok {rc=0} 10:26:32.180116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8816): Launched 10:26:32.527492 run osmo-hlr_10.42.42.2(pid=8817): Launched 10:26:32.656009 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:33.236088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8819): Launched 10:26:33.572447 run osmo-stp_10.42.42.5(pid=8820): Launched 10:26:33.700895 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:34.304637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8822): Launched 10:26:34.641889 run osmo-msc_10.42.42.6(pid=8823): Launched 10:26:34.828160 run osmo-stp_10.42.42.5(pid=8820): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8820)] 10:26:34.968413 run osmo-stp_10.42.42.5(pid=8820): stdout: | (launched: 2022-12-13_10:26:33.509429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:35.109390 run osmo-stp_10.42.42.5(pid=8820): stderr: | 20221213102633701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102633701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102633702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102633702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102633703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102633703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102633703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:35.247639 run osmo-stp_10.42.42.5(pid=8820): stdout: | (launched: 2022-12-13_10:26:33.509429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:35.380344 run osmo-stp_10.42.42.5(pid=8820): stderr: | 20221213102633701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102633701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102633702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102633702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102633703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102633703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102633703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:35.539527 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8820): Process ended prematurely: osmo-stp_10.42.42.5(pid=8820) [trial-2388↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8820)] [trial-2388↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 10:26:35.549268 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:26:35.577094 run osmo-hlr_10.42.42.2(pid=8817): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8817)] 10:26:35.628234 run osmo-hlr_10.42.42.2(pid=8817): stdout: | (launched: 2022-12-13_10:26:32.463803) 10:26:35.680739 run osmo-hlr_10.42.42.2(pid=8817): stderr: | 20221213102632661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102632661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102632661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102632661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102632662 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102632662 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102632673 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102632682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102632682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102632682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:35.754156 run osmo-msc_10.42.42.6(pid=8823): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8823)] 10:26:35.804504 run osmo-msc_10.42.42.6(pid=8823): stdout: | (launched: 2022-12-13_10:26:34.578959) 10:26:35.857310 run osmo-msc_10.42.42.6(pid=8823): stderr: | 20221213102634902 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102634902 DLGLOBAL DEBUG validating counter group 0x7f53650b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102634902 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102634902 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102634902 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102634903 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102634904 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102634905 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102634905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102634905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:35.909788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8816): Terminating (SIGTERM) 10:26:35.951674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8819): Terminating (SIGTERM) 10:26:35.994168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8822): Terminating (SIGTERM) 10:26:36.036624 --- ParallelTerminationStrategy: PID 8816 died... 10:26:36.057232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8816): Terminated: ok {rc=0} 10:26:36.104050 --- ParallelTerminationStrategy: PID 8819 died... 10:26:36.123915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8819): Terminated: ok {rc=0} 10:26:36.170486 --- ParallelTerminationStrategy: PID 8822 died... 10:26:36.190419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8822): Terminated: ok {rc=0} 10:26:36.279509 bus /sierra_3: Setting Powered False 10:26:37.380907 bus /sierra_3: Setting Powered False 10:26:38.498423 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 10:26:39.648868 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:26:39.660586 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 10:26:39.711855 tst mo_mt_call_osmux.py: using LAC 33306 10:26:39.835176 tst mo_mt_call_osmux.py: using RAC 156 10:26:39.958874 tst mo_mt_call_osmux.py: using CellId 33306 10:26:40.082714 tst mo_mt_call_osmux.py: using BVCI 33307 10:26:40.197584 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:26:40.209251 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:26:40.219927 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:26:40.230700 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:26:40.242003 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:26:40.253429 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:26:40.376048 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:26:40.496708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:40.981192 run create_hlr_db(pid=8825): Launched 10:26:41.109880 bus /sierra_2: Setting Powered False 10:26:42.171989 run create_hlr_db(pid=8825): Terminated: ok {rc=0} 10:26:42.607737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8827): Launched 10:26:42.922701 run osmo-hlr_10.42.42.2(pid=8828): Launched 10:26:43.042448 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:43.580424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8830): Launched 10:26:43.896248 run osmo-stp_10.42.42.5(pid=8831): Launched 10:26:44.015946 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:44.582689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8833): Launched 10:26:44.895388 run osmo-msc_10.42.42.6(pid=8834): Launched 10:26:45.071020 run osmo-stp_10.42.42.5(pid=8831): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8831)] 10:26:45.202470 run osmo-stp_10.42.42.5(pid=8831): stdout: | (launched: 2022-12-13_10:26:43.836658) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:45.333398 run osmo-stp_10.42.42.5(pid=8831): stderr: | 20221213102644008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102644008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102644008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102644008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102644009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102644009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102644009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:45.462441 run osmo-stp_10.42.42.5(pid=8831): stdout: | (launched: 2022-12-13_10:26:43.836658) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:45.586285 run osmo-stp_10.42.42.5(pid=8831): stderr: | 20221213102644008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102644008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102644008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102644008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102644009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102644009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102644009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:45.734895 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8831): Process ended prematurely: osmo-stp_10.42.42.5(pid=8831) [trial-2388↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8831)] [trial-2388↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 10:26:45.743843 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:26:45.770228 run osmo-hlr_10.42.42.2(pid=8828): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8828)] 10:26:45.818679 run osmo-hlr_10.42.42.2(pid=8828): stdout: | (launched: 2022-12-13_10:26:42.863293) 10:26:45.889199 run osmo-hlr_10.42.42.2(pid=8828): stderr: | 20221213102643039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102643039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102643040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102643040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102643040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102643040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102643051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102643060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102643060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102643060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:45.969812 run osmo-msc_10.42.42.6(pid=8834): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8834)] 10:26:46.022984 run osmo-msc_10.42.42.6(pid=8834): stdout: | (launched: 2022-12-13_10:26:44.836029) 10:26:46.079940 run osmo-msc_10.42.42.6(pid=8834): stderr: | 20221213102645109 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102645109 DLGLOBAL DEBUG validating counter group 0x7f3f1bb2cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102645109 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102645109 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102645110 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102645110 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102645111 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102645112 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102645112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102645112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:46.135605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8827): Terminating (SIGTERM) 10:26:46.180257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8830): Terminating (SIGTERM) 10:26:46.228026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8833): Terminating (SIGTERM) 10:26:46.275180 --- ParallelTerminationStrategy: PID 8827 died... 10:26:46.297552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8827): Terminated: ok {rc=0} 10:26:46.348112 --- ParallelTerminationStrategy: PID 8830 died... 10:26:46.369594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8830): Terminated: ok {rc=0} 10:26:46.419301 --- ParallelTerminationStrategy: PID 8833 died... 10:26:46.442449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8833): Terminated: ok {rc=0} 10:26:46.536987 bus /sierra_3: Setting Powered False 10:26:47.639251 bus /sierra_3: Setting Powered False 10:26:48.757632 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:26:50.012110 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:26:50.019116 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:26:50.053577 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 10:26:50.082390 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 10:26:50.135367 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:26:50.169169 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 10:26:50.197262 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 10:26:50.747767 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 10:26:50.798530 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:50.809991 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:26:50.861406 tst mo_mt_call.py: using LAC 33307 10:26:50.983814 tst mo_mt_call.py: using RAC 157 10:26:51.108519 tst mo_mt_call.py: using CellId 33307 10:26:51.232312 tst mo_mt_call.py: using BVCI 33308 10:26:51.347496 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:51.358814 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:51.369961 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:51.381043 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:51.392686 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:51.404306 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:26:51.527271 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:26:51.647624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:52.134838 run create_hlr_db(pid=8841): Launched 10:26:52.263473 bus /sierra_2: Setting Powered False 10:26:53.325303 run create_hlr_db(pid=8841): Terminated: ok {rc=0} 10:26:53.784867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8843): Launched 10:26:54.121189 run osmo-hlr_10.42.42.2(pid=8844): Launched 10:26:54.249726 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:54.832485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8846): Launched 10:26:55.171173 run osmo-stp_10.42.42.5(pid=8847): Launched 10:26:55.298191 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:55.905136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8849): Launched 10:26:56.242340 run osmo-msc_10.42.42.6(pid=8850): Launched 10:26:56.431011 run osmo-stp_10.42.42.5(pid=8847): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8847)] 10:26:56.572843 run osmo-stp_10.42.42.5(pid=8847): stdout: | (launched: 2022-12-13_10:26:55.107747) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:56.715276 run osmo-stp_10.42.42.5(pid=8847): stderr: | 20221213102655300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102655300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102655300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102655301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102655301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102655301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102655301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:56.854669 run osmo-stp_10.42.42.5(pid=8847): stdout: | (launched: 2022-12-13_10:26:55.107747) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:56.987954 run osmo-stp_10.42.42.5(pid=8847): stderr: | 20221213102655300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102655300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102655300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102655301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102655301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102655301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102655301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:57.147649 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8847): Process ended prematurely: osmo-stp_10.42.42.5(pid=8847) [trial-2388↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8847)] [trial-2388↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 10:26:57.157365 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:26:57.185246 run osmo-hlr_10.42.42.2(pid=8844): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8844)] 10:26:57.236462 run osmo-hlr_10.42.42.2(pid=8844): stdout: | (launched: 2022-12-13_10:26:54.058247) 10:26:57.289631 run osmo-hlr_10.42.42.2(pid=8844): stderr: | 20221213102654256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102654256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102654256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102654256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102654257 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102654257 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102654271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102654280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102654280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102654280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:57.363430 run osmo-msc_10.42.42.6(pid=8850): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8850)] 10:26:57.414128 run osmo-msc_10.42.42.6(pid=8850): stdout: | (launched: 2022-12-13_10:26:56.178996) 10:26:57.466873 run osmo-msc_10.42.42.6(pid=8850): stderr: | 20221213102656501 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102656502 DLGLOBAL DEBUG validating counter group 0x7f99c6108c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102656502 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102656502 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102656502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102656502 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102656504 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102656504 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102656504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102656504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:57.521194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8843): Terminating (SIGTERM) 10:26:57.563578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8846): Terminating (SIGTERM) 10:26:57.606565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8849): Terminating (SIGTERM) 10:26:57.649556 --- ParallelTerminationStrategy: PID 8843 died... 10:26:57.670242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8843): Terminated: ok {rc=0} 10:26:57.717404 --- ParallelTerminationStrategy: PID 8846 died... 10:26:57.737421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8846): Terminated: ok {rc=0} 10:26:57.784584 --- ParallelTerminationStrategy: PID 8849 died... 10:26:57.804719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8849): Terminated: ok {rc=0} 10:26:57.894155 bus /sierra_3: Setting Powered False 10:26:58.995352 bus /sierra_3: Setting Powered False 10:27:00.114734 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 10:27:01.262313 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:27:01.275511 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:27:01.333503 tst mo_mt_call_osmux.py: using LAC 33308 10:27:01.483441 tst mo_mt_call_osmux.py: using RAC 158 10:27:01.638277 tst mo_mt_call_osmux.py: using CellId 33308 10:27:01.763553 tst mo_mt_call_osmux.py: using BVCI 33309 10:27:01.878577 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:27:01.891257 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:27:01.903116 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:27:01.915453 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:27:01.927771 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:27:01.939498 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:27:02.078790 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:27:02.216880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:02.704160 run create_hlr_db(pid=8852): Launched 10:27:02.833868 bus /sierra_2: Setting Powered False 10:27:03.895760 run create_hlr_db(pid=8852): Terminated: ok {rc=0} 10:27:04.352016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8854): Launched 10:27:04.690414 run osmo-hlr_10.42.42.2(pid=8856): Launched 10:27:04.819391 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:05.399626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8858): Launched 10:27:05.738095 run osmo-stp_10.42.42.5(pid=8859): Launched 10:27:05.864685 run osmo-msc_10.42.42.6: Starting osmo-msc 10:27:06.468416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8861): Launched 10:27:06.806634 run osmo-msc_10.42.42.6(pid=8862): Launched 10:27:06.994170 run osmo-stp_10.42.42.5(pid=8859): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8859)] 10:27:07.135391 run osmo-stp_10.42.42.5(pid=8859): stdout: | (launched: 2022-12-13_10:27:05.675004) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:07.288287 run osmo-stp_10.42.42.5(pid=8859): stderr: | 20221213102705867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102705867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102705867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102705867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102705868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102705868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102705868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:07.427280 run osmo-stp_10.42.42.5(pid=8859): stdout: | (launched: 2022-12-13_10:27:05.675004) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:07.561121 run osmo-stp_10.42.42.5(pid=8859): stderr: | 20221213102705867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102705867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102705867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102705867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102705868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102705868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102705868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:07.720333 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8859): Process ended prematurely: osmo-stp_10.42.42.5(pid=8859) [trial-2388↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8859)] [trial-2388↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 10:27:07.730070 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:27:07.757935 run osmo-hlr_10.42.42.2(pid=8856): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8856)] 10:27:07.809321 run osmo-hlr_10.42.42.2(pid=8856): stdout: | (launched: 2022-12-13_10:27:04.627108) 10:27:07.862435 run osmo-hlr_10.42.42.2(pid=8856): stderr: | 20221213102704824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102704824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102704824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102704824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102704824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102704824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102704838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102704849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102704849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102704849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:07.935936 run osmo-msc_10.42.42.6(pid=8862): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8862)] 10:27:07.986682 run osmo-msc_10.42.42.6(pid=8862): stdout: | (launched: 2022-12-13_10:27:06.743481) 10:27:08.039773 run osmo-msc_10.42.42.6(pid=8862): stderr: | 20221213102707066 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102707067 DLGLOBAL DEBUG validating counter group 0x7fec92919c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102707067 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102707067 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102707067 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102707067 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102707069 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102707070 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102707070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102707070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:27:08.092747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8854): Terminating (SIGTERM) 10:27:08.135393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8858): Terminating (SIGTERM) 10:27:08.178053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8861): Terminating (SIGTERM) 10:27:08.220746 --- ParallelTerminationStrategy: PID 8854 died... 10:27:08.241461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8854): Terminated: ok {rc=0} 10:27:08.288506 --- ParallelTerminationStrategy: PID 8858 died... 10:27:08.308562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8858): Terminated: ok {rc=0} 10:27:08.355595 --- ParallelTerminationStrategy: PID 8861 died... 10:27:08.375700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8861): Terminated: ok {rc=0} 10:27:08.465075 bus /sierra_3: Setting Powered False 10:27:09.565721 bus /sierra_3: Setting Powered False 10:27:10.684835 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 emergency:trx-b200 --------------------------------------------------------------------- 10:27:11.939100 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:27:11.943716 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 10:27:11.976506 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 10:27:12.003320 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 10:27:12.088082 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 10:27:12.120764 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 10:27:12.147096 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 10:27:12.730696 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2388 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 10:27:12.735720 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:27:12.746366 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 10:27:12.794050 tst emergency_mo_mt_call.py: using LAC 33309 10:27:12.922130 tst emergency_mo_mt_call.py: using RAC 159 10:27:13.042193 tst emergency_mo_mt_call.py: using CellId 33309 10:27:13.160581 tst emergency_mo_mt_call.py: using BVCI 33310 10:27:13.271120 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:27:13.281929 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:27:13.292413 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:27:13.302950 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:27:13.313397 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:27:13.323758 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:27:13.446187 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:27:13.562888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:14.039161 run create_hlr_db(pid=8867): Launched 10:27:14.165580 bus /sierra_2: Setting Powered False 10:27:15.226511 run create_hlr_db(pid=8867): Terminated: ok {rc=0} 10:27:15.657381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8869): Launched 10:27:15.985769 run osmo-hlr_10.42.42.2(pid=8870): Launched 10:27:16.230309 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:16.948501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8872): Launched 10:27:17.300866 run osmo-stp_10.42.42.5(pid=8873): Launched 10:27:17.459659 tst emergency_mo_mt_call.py: using MSISDN 8109 10:27:17.630429 run osmo-msc_10.42.42.6: Starting osmo-msc 10:27:18.220759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8875): Launched 10:27:18.552447 run osmo-msc_10.42.42.6(pid=8876): Launched 10:27:18.736171 run osmo-stp_10.42.42.5(pid=8873): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8873)] 10:27:18.874411 run osmo-stp_10.42.42.5(pid=8873): stdout: | (launched: 2022-12-13_10:27:17.237945) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:19.014372 run osmo-stp_10.42.42.5(pid=8873): stderr: | 20221213102717457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102717457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102717457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102717458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102717458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102717458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102717458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:19.151298 run osmo-stp_10.42.42.5(pid=8873): stdout: | (launched: 2022-12-13_10:27:17.237945) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:19.281984 run osmo-stp_10.42.42.5(pid=8873): stderr: | 20221213102717457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102717457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102717457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102717458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102717458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102717458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102717458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:19.438455 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8873): Process ended prematurely: osmo-stp_10.42.42.5(pid=8873) [trial-2388↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8873)] [trial-2388↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 10:27:19.447467 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 10:27:19.475033 run osmo-hlr_10.42.42.2(pid=8870): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8870)] 10:27:19.526279 run osmo-hlr_10.42.42.2(pid=8870): stdout: | (launched: 2022-12-13_10:27:15.922679) 10:27:19.579342 run osmo-hlr_10.42.42.2(pid=8870): stderr: | 20221213102716206 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102716206 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102716207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102716207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102716207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102716207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102716229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102716243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102716243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102716243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:19.652682 run osmo-msc_10.42.42.6(pid=8876): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8876)] 10:27:19.703238 run osmo-msc_10.42.42.6(pid=8876): stdout: | (launched: 2022-12-13_10:27:18.489987) 10:27:19.756240 run osmo-msc_10.42.42.6(pid=8876): stderr: | 20221213102718811 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102718811 DLGLOBAL DEBUG validating counter group 0x7fa7cfe15c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102718811 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102718811 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102718811 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102718812 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102718813 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102718814 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102718814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102718814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:27:19.809493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8869): Terminating (SIGTERM) 10:27:19.851594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8872): Terminating (SIGTERM) 10:27:19.894231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8875): Terminating (SIGTERM) 10:27:19.937666 --- ParallelTerminationStrategy: PID 8869 died... 10:27:19.958271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8869): Terminated: ok {rc=0} 10:27:20.005493 --- ParallelTerminationStrategy: PID 8872 died... 10:27:20.025540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8872): Terminated: ok {rc=0} 10:27:20.072326 --- ParallelTerminationStrategy: PID 8875 died... 10:27:20.092556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8875): Terminated: ok {rc=0} 10:27:20.182917 bus /sierra_3: Setting Powered False 10:27:21.282727 bus /sierra_3: Setting Powered False 10:27:22.403042 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 10:27:23.492218 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:27:23.503678 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 10:27:23.557473 tst emergency_preemptive_call.py: using LAC 33310 10:27:23.677665 tst emergency_preemptive_call.py: using RAC 160 10:27:23.795878 tst emergency_preemptive_call.py: using CellId 33310 10:27:23.914014 tst emergency_preemptive_call.py: using BVCI 33311 10:27:24.025893 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:27:24.036552 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:27:24.047688 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:27:24.058317 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:27:24.068750 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:27:24.079646 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:27:24.195877 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:27:24.318285 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:27:24.435800 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:27:24.553972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:25.033559 run create_hlr_db(pid=8878): Launched 10:27:25.158239 bus /sierra_2: Setting Powered False 10:27:26.218930 run create_hlr_db(pid=8878): Terminated: ok {rc=0} 10:27:26.649098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8880): Launched 10:27:26.958755 run osmo-hlr_10.42.42.2(pid=8881): Launched 10:27:27.074134 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:27.616070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8883): Launched 10:27:27.925149 run osmo-stp_10.42.42.5(pid=8884): Launched 10:27:28.051969 tst emergency_preemptive_call.py: using MSISDN 8110 10:27:28.207263 run osmo-msc_10.42.42.6: Starting osmo-msc 10:27:28.759485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8886): Launched 10:27:29.067762 run osmo-msc_10.42.42.6(pid=8887): Launched 10:27:29.241894 run osmo-stp_10.42.42.5(pid=8884): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8884)] 10:27:29.379244 run osmo-stp_10.42.42.5(pid=8884): stdout: | (launched: 2022-12-13_10:27:27.866644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:29.521926 run osmo-stp_10.42.42.5(pid=8884): stderr: | 20221213102728039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102728039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102728039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102728039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102728040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102728040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102728040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:29.659103 run osmo-stp_10.42.42.5(pid=8884): stdout: | (launched: 2022-12-13_10:27:27.866644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:29.790125 run osmo-stp_10.42.42.5(pid=8884): stderr: | 20221213102728039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102728039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102728039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102728039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102728040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102728040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102728040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:29.946699 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8884): Process ended prematurely: osmo-stp_10.42.42.5(pid=8884) [trial-2388↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8884)] [trial-2388↪emergency:trx-b200↪emergency_preemptive_call.py:32] 10:27:29.956042 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 10:27:29.984208 run osmo-hlr_10.42.42.2(pid=8881): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8881)] 10:27:30.036347 run osmo-hlr_10.42.42.2(pid=8881): stdout: | (launched: 2022-12-13_10:27:26.899923) 10:27:30.089529 run osmo-hlr_10.42.42.2(pid=8881): stderr: | 20221213102727078 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102727078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102727078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102727078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102727078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102727078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102727091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102727100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102727101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102727101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:30.163249 run osmo-msc_10.42.42.6(pid=8887): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8887)] 10:27:30.214483 run osmo-msc_10.42.42.6(pid=8887): stdout: | (launched: 2022-12-13_10:27:29.009090) 10:27:30.267712 run osmo-msc_10.42.42.6(pid=8887): stderr: | 20221213102729281 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213102729281 DLGLOBAL DEBUG validating counter group 0x7f03b2f41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213102729281 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213102729281 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213102729281 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213102729282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213102729283 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213102729284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213102729284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213102729284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:27:30.321332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8880): Terminating (SIGTERM) 10:27:30.364019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8883): Terminating (SIGTERM) 10:27:30.407361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8886): Terminating (SIGTERM) 10:27:30.450730 --- ParallelTerminationStrategy: PID 8880 died... 10:27:30.471795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8880): Terminated: ok {rc=0} 10:27:30.520130 --- ParallelTerminationStrategy: PID 8883 died... 10:27:30.540456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8883): Terminated: ok {rc=0} 10:27:30.587954 --- ParallelTerminationStrategy: PID 8886 died... 10:27:30.608230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8886): Terminated: ok {rc=0} 10:27:30.697862 bus /sierra_9: Setting Powered False 10:27:31.798300 bus /sierra_9: Setting Powered False 10:27:32.916276 bus /sierra_8: Setting Powered False 10:27:34.015671 bus /sierra_8: Setting Powered False 10:27:35.134211 bus /sierra_3: Setting Powered False 10:27:36.234530 bus /sierra_3: Setting Powered False 10:27:37.353590 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-b200 --------------------------------------------------------------------- 10:27:38.642542 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:27:38.647244 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 10:27:38.681179 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 10:27:38.721105 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 10:27:38.810512 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 10:27:38.844395 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 10:27:38.883829 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 10:27:39.473903 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 10:27:39.529262 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:39.540318 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:27:39.594401 tst cs_paging_gprs_active.py: using LAC 33311 10:27:39.723855 tst cs_paging_gprs_active.py: using RAC 161 10:27:39.846877 tst cs_paging_gprs_active.py: using CellId 33311 10:27:39.970521 tst cs_paging_gprs_active.py: using BVCI 33312 10:27:40.086662 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:40.097596 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:40.108147 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:40.118800 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:40.129641 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:40.140487 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:40.151592 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:40.162489 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:40.173644 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:27:40.297497 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:27:40.420000 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:27:40.648057 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:27:40.987820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8892): Launched 10:27:41.280413 run iperf3-srv_10.42.42.10(pid=8893): Launched 10:27:41.407857 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:27:41.634868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:27:41.973146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8894): Launched 10:27:42.267063 run iperf3-srv_10.42.42.10(pid=8895): Launched 10:27:42.392179 tst cs_paging_gprs_active.py:38: start network... 10:27:42.618831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:43.139658 run create_hlr_db(pid=8896): Launched 10:27:43.268377 bus /sierra_2: Setting Powered False 10:27:44.334522 run create_hlr_db(pid=8896): Terminated: ok {rc=0} 10:27:44.801958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8898): Launched 10:27:45.138957 run osmo-hlr_10.42.42.2(pid=8899): Launched 10:27:45.268038 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:45.847433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8901): Launched 10:27:46.185955 run osmo-stp_10.42.42.5(pid=8902): Launched 10:27:46.378961 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:27:47.044810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8904): Launched 10:27:47.179078 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:27:47.452147 run patchelf(pid=8905): Launched 10:27:47.627600 run osmo-stp_10.42.42.5(pid=8902): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8902)] 10:27:47.759495 run osmo-stp_10.42.42.5(pid=8902): stdout: | (launched: 2022-12-13_10:27:46.125215) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:47.892754 run osmo-stp_10.42.42.5(pid=8902): stderr: | 20221213102746459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102746460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102746460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102746460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102746473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102746473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102746473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:48.025888 run osmo-stp_10.42.42.5(pid=8902): stdout: | (launched: 2022-12-13_10:27:46.125215) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:48.153662 run osmo-stp_10.42.42.5(pid=8902): stderr: | 20221213102746459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102746460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102746460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102746460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102746473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102746473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102746473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:48.304795 run patchelf(pid=8905): Terminating (SIGINT) 10:27:48.480665 run patchelf(pid=8905): Terminated: ok {rc=0} 10:27:48.607466 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8902): Process ended prematurely: osmo-stp_10.42.42.5(pid=8902) [trial-2388↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8902)] [trial-2388↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 10:27:48.617225 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 10:27:48.644399 run osmo-hlr_10.42.42.2(pid=8899): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8899)] 10:27:48.692440 run osmo-hlr_10.42.42.2(pid=8899): stdout: | (launched: 2022-12-13_10:27:45.075944) 10:27:48.742315 run osmo-hlr_10.42.42.2(pid=8899): stderr: | 20221213102745273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102745273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102745273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102745273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102745273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102745273 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102745286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102745294 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102745294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102745294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:48.792349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8892): Terminating (SIGTERM) 10:27:48.832503 run iperf3-srv_10.42.42.10(pid=8893): Terminating (SIGTERM) 10:27:48.872804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8894): Terminating (SIGTERM) 10:27:48.913886 run iperf3-srv_10.42.42.10(pid=8895): Terminating (SIGTERM) 10:27:48.954396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8898): Terminating (SIGTERM) 10:27:48.995102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8901): Terminating (SIGTERM) 10:27:49.034885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8904): Terminating (SIGTERM) 10:27:49.074962 --- ParallelTerminationStrategy: PID 8892 died... 10:27:49.094278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8892): Terminated: ok {rc=0} 10:27:49.138686 --- ParallelTerminationStrategy: PID 8893 died... 10:27:49.157258 run iperf3-srv_10.42.42.10(pid=8893): Terminated {rc=256} 10:27:49.201304 --- ParallelTerminationStrategy: PID 8894 died... 10:27:49.219952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8894): Terminated: ok {rc=0} 10:27:49.264167 --- ParallelTerminationStrategy: PID 8895 died... 10:27:49.282936 run iperf3-srv_10.42.42.10(pid=8895): Terminated {rc=256} 10:27:49.326829 --- ParallelTerminationStrategy: PID 8898 died... 10:27:49.345560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8898): Terminated: ok {rc=0} 10:27:49.389583 --- ParallelTerminationStrategy: PID 8901 died... 10:27:49.408078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8901): Terminated: ok {rc=0} 10:27:49.452283 --- ParallelTerminationStrategy: PID 8904 died... 10:27:49.471084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8904): Terminated: ok {rc=0} 10:27:49.555978 bus /gobi_0: Setting Powered False 10:27:50.655939 bus /gobi_0: Setting Powered False 10:27:51.774811 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200 iperf3.py ---------------------------------------------- 10:27:52.927669 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:52.939841 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:27:52.993384 tst iperf3.py: using LAC 33312 10:27:53.125718 tst iperf3.py: using RAC 162 10:27:53.257653 tst iperf3.py: using CellId 33312 10:27:53.390935 tst iperf3.py: using BVCI 33313 10:27:53.514017 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:53.525595 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:53.536513 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:53.547639 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:53.558891 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:53.570111 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:53.581939 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:53.593162 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:27:53.604595 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:27:53.727199 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:27:53.953661 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:27:54.292491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8906): Launched 10:27:54.585417 run iperf3-srv_10.42.42.10(pid=8907): Launched 10:27:54.710219 tst iperf3.py:8: start network... 10:27:54.935015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:55.454213 run create_hlr_db(pid=8908): Launched 10:27:55.583149 bus /gobi_6: Setting Powered False 10:27:56.648835 run create_hlr_db(pid=8908): Terminated: ok {rc=0} 10:27:57.095700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8910): Launched 10:27:57.411097 run osmo-hlr_10.42.42.2(pid=8911): Launched 10:27:57.531468 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:58.071702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8913): Launched 10:27:58.387431 run osmo-stp_10.42.42.5(pid=8914): Launched 10:27:58.507163 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:27:59.047927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8916): Launched 10:27:59.168277 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:27:59.433601 run patchelf(pid=8917): Launched 10:27:59.606650 run osmo-stp_10.42.42.5(pid=8914): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8914)] 10:27:59.737989 run osmo-stp_10.42.42.5(pid=8914): stdout: | (launched: 2022-12-13_10:27:58.327955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:59.871258 run osmo-stp_10.42.42.5(pid=8914): stderr: | 20221213102758499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102758499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102758499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102758500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102758500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102758500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102758501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:00.004342 run osmo-stp_10.42.42.5(pid=8914): stdout: | (launched: 2022-12-13_10:27:58.327955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:00.131667 run osmo-stp_10.42.42.5(pid=8914): stderr: | 20221213102758499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102758499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102758499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102758500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102758500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102758500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102758501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:00.282246 run patchelf(pid=8917): Terminating (SIGINT) 10:28:00.457660 run patchelf(pid=8917): Terminated: ok {rc=0} 10:28:00.584379 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8914): Process ended prematurely: osmo-stp_10.42.42.5(pid=8914) [trial-2388↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8914)] [trial-2388↪gprs:trx-b200↪iperf3.py:8] 10:28:00.594037 tst iperf3.py:8: Test FAILED (7.7 sec) 10:28:00.621190 run osmo-hlr_10.42.42.2(pid=8911): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8911)] 10:28:00.669491 run osmo-hlr_10.42.42.2(pid=8911): stdout: | (launched: 2022-12-13_10:27:57.351317) 10:28:00.719261 run osmo-hlr_10.42.42.2(pid=8911): stderr: | 20221213102757530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102757530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102757530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102757530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102757530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102757530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102757542 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102757551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102757551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102757551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:00.769793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8906): Terminating (SIGTERM) 10:28:00.809855 run iperf3-srv_10.42.42.10(pid=8907): Terminating (SIGTERM) 10:28:00.849752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8910): Terminating (SIGTERM) 10:28:00.893445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8913): Terminating (SIGTERM) 10:28:00.938137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8916): Terminating (SIGTERM) 10:28:00.983752 --- ParallelTerminationStrategy: PID 8906 died... 10:28:01.004055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8906): Terminated: ok {rc=0} 10:28:01.050078 --- ParallelTerminationStrategy: PID 8907 died... 10:28:01.070136 run iperf3-srv_10.42.42.10(pid=8907): Terminated {rc=256} 10:28:01.115787 --- ParallelTerminationStrategy: PID 8910 died... 10:28:01.135179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8910): Terminated: ok {rc=0} 10:28:01.180087 --- ParallelTerminationStrategy: PID 8913 died... 10:28:01.199583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8913): Terminated: ok {rc=0} 10:28:01.244612 --- ParallelTerminationStrategy: PID 8916 died... 10:28:01.264217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8916): Terminated: ok {rc=0} 10:28:01.350165 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 10:28:02.495415 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:02.507103 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:28:02.557420 tst iperf3m4.py: using LAC 33313 10:28:02.679282 tst iperf3m4.py: using RAC 163 10:28:02.803040 tst iperf3m4.py: using CellId 33313 10:28:02.927447 tst iperf3m4.py: using BVCI 33314 10:28:03.042833 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:03.053891 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:03.064651 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:03.075387 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:03.086460 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:03.097239 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:03.107851 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:03.118623 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:03.129529 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:28:03.247445 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:28:03.372394 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:28:03.492561 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:28:03.616638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:28:03.844139 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:04.182556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8918): Launched 10:28:04.476175 run iperf3-srv_10.42.42.10(pid=8919): Launched 10:28:04.602366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:28:04.828337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:05.166832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8920): Launched 10:28:05.461170 run iperf3-srv_10.42.42.10(pid=8921): Launched 10:28:05.588432 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:28:05.814084 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:06.152128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8922): Launched 10:28:06.444275 run iperf3-srv_10.42.42.10(pid=8923): Launched 10:28:06.571248 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:28:06.796308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:07.133596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8924): Launched 10:28:07.426922 run iperf3-srv_10.42.42.10(pid=8925): Launched 10:28:07.552616 tst iperf3m4.py:8: start network... 10:28:07.778673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:08.299847 run create_hlr_db(pid=8926): Launched 10:28:08.428468 bus /gobi_6: Setting Powered False 10:28:09.494501 run create_hlr_db(pid=8926): Terminated: ok {rc=0} 10:28:09.943337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8928): Launched 10:28:10.259720 run osmo-hlr_10.42.42.2(pid=8929): Launched 10:28:10.380154 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:10.918946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8931): Launched 10:28:11.234774 run osmo-stp_10.42.42.5(pid=8932): Launched 10:28:11.354928 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:28:11.894083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8934): Launched 10:28:12.013274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:28:12.279292 run patchelf(pid=8935): Launched 10:28:12.452688 run osmo-stp_10.42.42.5(pid=8932): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8932)] 10:28:12.584831 run osmo-stp_10.42.42.5(pid=8932): stdout: | (launched: 2022-12-13_10:28:11.175254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:12.718372 run osmo-stp_10.42.42.5(pid=8932): stderr: | 20221213102811346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102811346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102811346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102811347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102811347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102811348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102811348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:12.851251 run osmo-stp_10.42.42.5(pid=8932): stdout: | (launched: 2022-12-13_10:28:11.175254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:12.978572 run osmo-stp_10.42.42.5(pid=8932): stderr: | 20221213102811346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102811346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102811346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102811347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102811347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102811348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102811348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:13.130664 run patchelf(pid=8935): Terminating (SIGINT) 10:28:13.305849 run patchelf(pid=8935): Terminated: ok {rc=0} 10:28:13.432476 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8932): Process ended prematurely: osmo-stp_10.42.42.5(pid=8932) [trial-2388↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8932)] [trial-2388↪gprs:trx-b200↪iperf3m4.py:8] 10:28:13.442253 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:28:13.469830 run osmo-hlr_10.42.42.2(pid=8929): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8929)] 10:28:13.518070 run osmo-hlr_10.42.42.2(pid=8929): stdout: | (launched: 2022-12-13_10:28:10.200251) 10:28:13.567966 run osmo-hlr_10.42.42.2(pid=8929): stderr: | 20221213102810376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102810376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102810376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102810376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102810376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102810376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102810389 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102810397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102810397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102810397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:13.618328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8918): Terminating (SIGTERM) 10:28:13.658340 run iperf3-srv_10.42.42.10(pid=8919): Terminating (SIGTERM) 10:28:13.698302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8920): Terminating (SIGTERM) 10:28:13.738502 run iperf3-srv_10.42.42.10(pid=8921): Terminating (SIGTERM) 10:28:13.778519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8922): Terminating (SIGTERM) 10:28:13.818799 run iperf3-srv_10.42.42.10(pid=8923): Terminating (SIGTERM) 10:28:13.858997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8924): Terminating (SIGTERM) 10:28:13.899202 run iperf3-srv_10.42.42.10(pid=8925): Terminating (SIGTERM) 10:28:13.939413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8928): Terminating (SIGTERM) 10:28:13.979683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8931): Terminating (SIGTERM) 10:28:14.019897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8934): Terminating (SIGTERM) 10:28:14.060335 --- ParallelTerminationStrategy: PID 8918 died... 10:28:14.079967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8918): Terminated: ok {rc=0} 10:28:14.124602 --- ParallelTerminationStrategy: PID 8919 died... 10:28:14.143520 run iperf3-srv_10.42.42.10(pid=8919): Terminated {rc=256} 10:28:14.187688 --- ParallelTerminationStrategy: PID 8920 died... 10:28:14.206601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8920): Terminated: ok {rc=0} 10:28:14.250885 --- ParallelTerminationStrategy: PID 8921 died... 10:28:14.269756 run iperf3-srv_10.42.42.10(pid=8921): Terminated {rc=256} 10:28:14.313849 --- ParallelTerminationStrategy: PID 8922 died... 10:28:14.332751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8922): Terminated: ok {rc=0} 10:28:14.377160 --- ParallelTerminationStrategy: PID 8923 died... 10:28:14.395776 run iperf3-srv_10.42.42.10(pid=8923): Terminated {rc=256} 10:28:14.439898 --- ParallelTerminationStrategy: PID 8924 died... 10:28:14.458846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8924): Terminated: ok {rc=0} 10:28:14.502853 --- ParallelTerminationStrategy: PID 8925 died... 10:28:14.521774 run iperf3-srv_10.42.42.10(pid=8925): Terminated {rc=256} 10:28:14.565750 --- ParallelTerminationStrategy: PID 8928 died... 10:28:14.584721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8928): Terminated: ok {rc=0} 10:28:14.628840 --- ParallelTerminationStrategy: PID 8931 died... 10:28:14.647645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8931): Terminated: ok {rc=0} 10:28:14.691874 --- ParallelTerminationStrategy: PID 8934 died... 10:28:14.710905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8934): Terminated: ok {rc=0} 10:28:14.797522 bus /gobi_4: Setting Powered False 10:28:15.917398 bus /gobi_4: Setting Powered False 10:28:17.072134 bus /gobi_1: Setting Powered False 10:28:18.187307 bus /gobi_1: Setting Powered False 10:28:19.305482 bus /gobi_0: Setting Powered False 10:28:20.405074 bus /gobi_0: Setting Powered False 10:28:21.522720 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200 ping.py ---------------------------------------------- 10:28:22.624530 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:22.635969 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:28:22.684666 tst ping.py: using LAC 33314 10:28:22.805743 tst ping.py: using RAC 164 10:28:22.926376 tst ping.py: using CellId 33314 10:28:23.048307 tst ping.py: using BVCI 33315 10:28:23.161637 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:23.172301 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:23.182867 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:23.193439 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:23.203795 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:23.214143 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:23.224570 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:23.235121 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:28:23.352052 tst ping.py:19: start network... 10:28:23.557651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:24.034927 run create_hlr_db(pid=8936): Launched 10:28:24.160492 bus /gobi_6: Setting Powered False 10:28:25.222203 run create_hlr_db(pid=8936): Terminated: ok {rc=0} 10:28:25.674759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8938): Launched 10:28:26.006788 run osmo-hlr_10.42.42.2(pid=8939): Launched 10:28:26.131308 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:26.701306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8941): Launched 10:28:27.034840 run osmo-stp_10.42.42.5(pid=8942): Launched 10:28:27.160126 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:28:27.730282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8944): Launched 10:28:27.857342 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:28:28.137269 run patchelf(pid=8945): Launched 10:28:28.320734 run osmo-stp_10.42.42.5(pid=8942): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8942)] 10:28:28.460284 run osmo-stp_10.42.42.5(pid=8942): stdout: | (launched: 2022-12-13_10:28:26.971988) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:28.601279 run osmo-stp_10.42.42.5(pid=8942): stderr: | 20221213102827164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102827164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102827164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102827164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102827165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102827165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102827165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:28.741945 run osmo-stp_10.42.42.5(pid=8942): stdout: | (launched: 2022-12-13_10:28:26.971988) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:28.877036 run osmo-stp_10.42.42.5(pid=8942): stderr: | 20221213102827164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102827164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102827164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102827164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102827165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102827165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102827165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:29.036876 run patchelf(pid=8945): Terminating (SIGINT) 10:28:29.221552 run patchelf(pid=8945): Terminated: ok {rc=0} 10:28:29.354594 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8942): Process ended prematurely: osmo-stp_10.42.42.5(pid=8942) [trial-2388↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8942)] [trial-2388↪gprs:trx-b200↪ping.py:22] 10:28:29.364366 tst ping.py:22: Test FAILED (6.7 sec) 10:28:29.393057 run osmo-hlr_10.42.42.2(pid=8939): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8939)] 10:28:29.444850 run osmo-hlr_10.42.42.2(pid=8939): stdout: | (launched: 2022-12-13_10:28:25.944446) 10:28:29.497441 run osmo-hlr_10.42.42.2(pid=8939): stderr: | 20221213102826142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102826142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102826142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102826142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102826142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102826142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102826155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102826164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102826164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102826164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:29.551456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8938): Terminating (SIGTERM) 10:28:29.594028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8941): Terminating (SIGTERM) 10:28:29.637088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8944): Terminating (SIGTERM) 10:28:29.680158 --- ParallelTerminationStrategy: PID 8938 died... 10:28:29.701178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8938): Terminated: ok {rc=0} 10:28:29.749167 --- ParallelTerminationStrategy: PID 8941 died... 10:28:29.769622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8941): Terminated: ok {rc=0} 10:28:29.817193 --- ParallelTerminationStrategy: PID 8944 died... 10:28:29.837402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8944): Terminated: ok {rc=0} 10:28:29.927997 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 10:28:31.017591 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:31.030222 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:28:31.084365 tst ping_idle_ping.py: using LAC 33315 10:28:31.218477 tst ping_idle_ping.py: using RAC 165 10:28:31.361306 tst ping_idle_ping.py: using CellId 33315 10:28:31.516541 tst ping_idle_ping.py: using BVCI 33316 10:28:31.638591 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:31.650060 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:31.661271 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:31.672636 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:31.683963 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:31.695465 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:31.706655 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:28:31.718143 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:28:31.836894 tst ping_idle_ping.py:24: start network... 10:28:32.083339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:32.604181 run create_hlr_db(pid=8946): Launched 10:28:32.731784 bus /gobi_6: Setting Powered False 10:28:33.797331 run create_hlr_db(pid=8946): Terminated: ok {rc=0} 10:28:34.239160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8948): Launched 10:28:34.547271 run osmo-hlr_10.42.42.2(pid=8949): Launched 10:28:34.665472 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:35.195036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8951): Launched 10:28:35.504062 run osmo-stp_10.42.42.5(pid=8952): Launched 10:28:35.620837 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:28:36.151361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8954): Launched 10:28:36.269537 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:28:36.530588 run patchelf(pid=8955): Launched 10:28:36.702312 run osmo-stp_10.42.42.5(pid=8952): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8952)] 10:28:36.832250 run osmo-stp_10.42.42.5(pid=8952): stdout: | (launched: 2022-12-13_10:28:35.445481) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:36.963768 run osmo-stp_10.42.42.5(pid=8952): stderr: | 20221213102835617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102835617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102835617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102835618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102835618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102835618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102835618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:37.095092 run osmo-stp_10.42.42.5(pid=8952): stdout: | (launched: 2022-12-13_10:28:35.445481) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:37.220517 run osmo-stp_10.42.42.5(pid=8952): stderr: | 20221213102835617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102835617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102835617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102835618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102835618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102835618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102835618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:37.370452 run patchelf(pid=8955): Terminating (SIGINT) 10:28:37.542898 run patchelf(pid=8955): Terminated: ok {rc=0} 10:28:37.667241 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8952): Process ended prematurely: osmo-stp_10.42.42.5(pid=8952) [trial-2388↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8952)] [trial-2388↪gprs:trx-b200↪ping_idle_ping.py:27] 10:28:37.676134 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:28:37.703070 run osmo-hlr_10.42.42.2(pid=8949): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8949)] 10:28:37.750672 run osmo-hlr_10.42.42.2(pid=8949): stdout: | (launched: 2022-12-13_10:28:34.488507) 10:28:37.800049 run osmo-hlr_10.42.42.2(pid=8949): stderr: | 20221213102834664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102834665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102834665 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102834665 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102834665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102834665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102834676 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102834685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102834685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102834685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:37.849870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8948): Terminating (SIGTERM) 10:28:37.889860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8951): Terminating (SIGTERM) 10:28:37.929763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8954): Terminating (SIGTERM) 10:28:37.970303 --- ParallelTerminationStrategy: PID 8948 died... 10:28:37.989493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8948): Terminated: ok {rc=0} 10:28:38.033687 --- ParallelTerminationStrategy: PID 8951 died... 10:28:38.052233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8951): Terminated: ok {rc=0} 10:28:38.096508 --- ParallelTerminationStrategy: PID 8954 died... 10:28:38.115266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8954): Terminated: ok {rc=0} 10:28:38.201501 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 10:28:39.516829 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:28:39.523139 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:28:39.558606 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:28:39.598301 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:28:39.690082 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:28:39.724377 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:28:39.763755 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:28:40.355621 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:28:40.410567 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:40.422135 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:28:40.473936 tst cs_paging_gprs_active.py: using LAC 33316 10:28:40.606035 tst cs_paging_gprs_active.py: using RAC 166 10:28:40.738172 tst cs_paging_gprs_active.py: using CellId 33316 10:28:40.870059 tst cs_paging_gprs_active.py: using BVCI 33317 10:28:40.994168 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:41.005817 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:41.017129 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:41.028472 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:41.040218 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:41.051986 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:41.064022 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:41.075569 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:41.087423 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:28:41.207846 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:28:41.329561 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:28:41.558515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:41.898697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8959): Launched 10:28:42.194762 run iperf3-srv_10.42.42.10(pid=8960): Launched 10:28:42.320502 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:28:42.548094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:42.887015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8961): Launched 10:28:43.181724 run iperf3-srv_10.42.42.10(pid=8962): Launched 10:28:43.308530 tst cs_paging_gprs_active.py:38: start network... 10:28:43.534756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:44.055357 run create_hlr_db(pid=8963): Launched 10:28:44.182633 bus /gobi_6: Setting Powered False 10:28:45.247950 run create_hlr_db(pid=8963): Terminated: ok {rc=0} 10:28:45.696101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8965): Launched 10:28:46.053622 run osmo-hlr_10.42.42.2(pid=8966): Launched 10:28:46.304408 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:46.957395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8968): Launched 10:28:47.314098 run osmo-stp_10.42.42.5(pid=8969): Launched 10:28:47.446743 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:28:48.029662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8971): Launched 10:28:48.160162 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:28:48.447147 run patchelf(pid=8972): Launched 10:28:48.636007 run osmo-stp_10.42.42.5(pid=8969): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8969)] 10:28:48.777434 run osmo-stp_10.42.42.5(pid=8969): stdout: | (launched: 2022-12-13_10:28:47.250377) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:48.920324 run osmo-stp_10.42.42.5(pid=8969): stderr: | 20221213102847440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102847440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102847441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102847441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102847441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102847442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102847442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:49.063277 run osmo-stp_10.42.42.5(pid=8969): stdout: | (launched: 2022-12-13_10:28:47.250377) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:49.200597 run osmo-stp_10.42.42.5(pid=8969): stderr: | 20221213102847440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102847440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102847441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102847441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102847441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102847442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102847442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:49.363260 run patchelf(pid=8972): Terminating (SIGINT) 10:28:49.551866 run patchelf(pid=8972): Terminated: ok {rc=0} 10:28:49.687648 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8969): Process ended prematurely: osmo-stp_10.42.42.5(pid=8969) [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8969)] [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:28:49.698101 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 10:28:49.726760 run osmo-hlr_10.42.42.2(pid=8966): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8966)] 10:28:49.778323 run osmo-hlr_10.42.42.2(pid=8966): stdout: | (launched: 2022-12-13_10:28:45.985546) 10:28:49.830575 run osmo-hlr_10.42.42.2(pid=8966): stderr: | 20221213102846257 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102846257 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102846257 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102846257 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102846258 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102846258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102846271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102846287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102846288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102846288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:49.883637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8959): Terminating (SIGTERM) 10:28:49.925870 run iperf3-srv_10.42.42.10(pid=8960): Terminating (SIGTERM) 10:28:49.968395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8961): Terminating (SIGTERM) 10:28:50.011544 run iperf3-srv_10.42.42.10(pid=8962): Terminating (SIGTERM) 10:28:50.054029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8965): Terminating (SIGTERM) 10:28:50.096552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8968): Terminating (SIGTERM) 10:28:50.139273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8971): Terminating (SIGTERM) 10:28:50.182196 --- ParallelTerminationStrategy: PID 8959 died... 10:28:50.202836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8959): Terminated: ok {rc=0} 10:28:50.249827 --- ParallelTerminationStrategy: PID 8960 died... 10:28:50.269884 run iperf3-srv_10.42.42.10(pid=8960): Terminated {rc=256} 10:28:50.316592 --- ParallelTerminationStrategy: PID 8961 died... 10:28:50.336763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8961): Terminated: ok {rc=0} 10:28:50.383617 --- ParallelTerminationStrategy: PID 8962 died... 10:28:50.403732 run iperf3-srv_10.42.42.10(pid=8962): Terminated {rc=256} 10:28:50.450463 --- ParallelTerminationStrategy: PID 8965 died... 10:28:50.470409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8965): Terminated: ok {rc=0} 10:28:50.517368 --- ParallelTerminationStrategy: PID 8968 died... 10:28:50.537562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8968): Terminated: ok {rc=0} 10:28:50.584669 --- ParallelTerminationStrategy: PID 8971 died... 10:28:50.605013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8971): Terminated: ok {rc=0} 10:28:50.694463 bus /gobi_0: Setting Powered False 10:28:51.793097 bus /gobi_0: Setting Powered False 10:28:52.908992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:28:54.057350 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:54.069004 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:28:54.121034 tst iperf3.py: using LAC 33317 10:28:54.242445 tst iperf3.py: using RAC 167 10:28:54.365453 tst iperf3.py: using CellId 33317 10:28:54.487444 tst iperf3.py: using BVCI 33318 10:28:54.600897 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:54.611938 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:54.622704 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:54.633408 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:54.643940 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:54.654507 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:54.665894 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:54.676559 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:54.687452 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:28:54.809676 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:28:55.036892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:55.376152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8973): Launched 10:28:55.671652 run iperf3-srv_10.42.42.10(pid=8974): Launched 10:28:55.797338 tst iperf3.py:8: start network... 10:28:56.023145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:56.544198 run create_hlr_db(pid=8975): Launched 10:28:56.673024 bus /gobi_6: Setting Powered False 10:28:57.738575 run create_hlr_db(pid=8975): Terminated: ok {rc=0} 10:28:58.205304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8977): Launched 10:28:58.542051 run osmo-hlr_10.42.42.2(pid=8978): Launched 10:28:58.672614 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:59.253875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8980): Launched 10:28:59.592239 run osmo-stp_10.42.42.5(pid=8981): Launched 10:28:59.722085 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:29:00.299252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8983): Launched 10:29:00.428156 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:29:00.712510 run patchelf(pid=8984): Launched 10:29:00.899808 run osmo-stp_10.42.42.5(pid=8981): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8981)] 10:29:01.044204 run osmo-stp_10.42.42.5(pid=8981): stdout: | (launched: 2022-12-13_10:28:59.528597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:01.189650 run osmo-stp_10.42.42.5(pid=8981): stderr: | 20221213102859720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102859720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102859720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102859720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102859721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102859721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102859721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:01.335491 run osmo-stp_10.42.42.5(pid=8981): stdout: | (launched: 2022-12-13_10:28:59.528597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:01.475412 run osmo-stp_10.42.42.5(pid=8981): stderr: | 20221213102859720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102859720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102859720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102859720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102859721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102859721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102859721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:01.641818 run patchelf(pid=8984): Terminating (SIGINT) 10:29:01.832522 run patchelf(pid=8984): Terminated: ok {rc=0} 10:29:01.971783 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8981): Process ended prematurely: osmo-stp_10.42.42.5(pid=8981) [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8981)] [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 10:29:01.983590 tst iperf3.py:8: Test FAILED (8.0 sec) 10:29:02.013499 run osmo-hlr_10.42.42.2(pid=8978): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8978)] 10:29:02.068754 run osmo-hlr_10.42.42.2(pid=8978): stdout: | (launched: 2022-12-13_10:28:58.478839) 10:29:02.123668 run osmo-hlr_10.42.42.2(pid=8978): stderr: | 20221213102858677 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102858677 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102858677 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102858677 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102858677 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102858677 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102858689 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102858697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102858697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102858697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:02.178830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8973): Terminating (SIGTERM) 10:29:02.222300 run iperf3-srv_10.42.42.10(pid=8974): Terminating (SIGTERM) 10:29:02.264392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8977): Terminating (SIGTERM) 10:29:02.307472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8980): Terminating (SIGTERM) 10:29:02.349515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8983): Terminating (SIGTERM) 10:29:02.391739 --- ParallelTerminationStrategy: PID 8973 died... 10:29:02.412196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8973): Terminated: ok {rc=0} 10:29:02.458717 --- ParallelTerminationStrategy: PID 8974 died... 10:29:02.478509 run iperf3-srv_10.42.42.10(pid=8974): Terminated {rc=256} 10:29:02.524729 --- ParallelTerminationStrategy: PID 8977 died... 10:29:02.544694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8977): Terminated: ok {rc=0} 10:29:02.591327 --- ParallelTerminationStrategy: PID 8980 died... 10:29:02.611285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8980): Terminated: ok {rc=0} 10:29:02.657664 --- ParallelTerminationStrategy: PID 8983 died... 10:29:02.677542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8983): Terminated: ok {rc=0} 10:29:02.766503 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:29:03.918494 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:03.930664 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:29:03.982684 tst iperf3m4.py: using LAC 33318 10:29:04.107122 tst iperf3m4.py: using RAC 168 10:29:04.230696 tst iperf3m4.py: using CellId 33318 10:29:04.352664 tst iperf3m4.py: using BVCI 33319 10:29:04.466007 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:04.476924 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:04.487867 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:04.498539 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:04.509002 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:04.519913 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:04.530968 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:04.541767 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:04.552677 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:29:04.672875 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:29:04.796819 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:29:04.915811 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:29:05.040211 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:29:05.267390 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:05.607236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8986): Launched 10:29:05.899925 run iperf3-srv_10.42.42.10(pid=8987): Launched 10:29:06.026907 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:29:06.252044 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:06.589678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8988): Launched 10:29:06.882704 run iperf3-srv_10.42.42.10(pid=8989): Launched 10:29:07.007762 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:29:07.233087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:07.570862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8990): Launched 10:29:07.863140 run iperf3-srv_10.42.42.10(pid=8991): Launched 10:29:07.988553 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:29:08.213873 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:08.551564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8992): Launched 10:29:08.846086 run iperf3-srv_10.42.42.10(pid=8993): Launched 10:29:08.970877 tst iperf3m4.py:8: start network... 10:29:09.196446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:09.716864 run create_hlr_db(pid=8994): Launched 10:29:09.845387 bus /gobi_6: Setting Powered False 10:29:10.911442 run create_hlr_db(pid=8994): Terminated: ok {rc=0} 10:29:11.358206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8996): Launched 10:29:11.674288 run osmo-hlr_10.42.42.2(pid=8997): Launched 10:29:11.792517 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:12.364200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8999): Launched 10:29:12.679906 run osmo-stp_10.42.42.5(pid=9000): Launched 10:29:12.799577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:29:13.336388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9002): Launched 10:29:13.457698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:29:13.724622 run patchelf(pid=9003): Launched 10:29:13.899104 run osmo-stp_10.42.42.5(pid=9000): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9000)] 10:29:14.031184 run osmo-stp_10.42.42.5(pid=9000): stdout: | (launched: 2022-12-13_10:29:12.620032) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:14.164262 run osmo-stp_10.42.42.5(pid=9000): stderr: | 20221213102912790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102912790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102912791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102912791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102912792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102912792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102912792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:14.297654 run osmo-stp_10.42.42.5(pid=9000): stdout: | (launched: 2022-12-13_10:29:12.620032) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:14.425208 run osmo-stp_10.42.42.5(pid=9000): stderr: | 20221213102912790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102912790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102912791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102912791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102912792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102912792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102912792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:14.576025 run patchelf(pid=9003): Terminating (SIGINT) 10:29:14.751205 run patchelf(pid=9003): Terminated: ok {rc=0} 10:29:14.877658 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9000): Process ended prematurely: osmo-stp_10.42.42.5(pid=9000) [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9000)] [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 10:29:14.887156 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:29:14.914819 run osmo-hlr_10.42.42.2(pid=8997): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8997)] 10:29:14.963066 run osmo-hlr_10.42.42.2(pid=8997): stdout: | (launched: 2022-12-13_10:29:11.614627) 10:29:15.012598 run osmo-hlr_10.42.42.2(pid=8997): stderr: | 20221213102911791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102911791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102911791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102911791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102911791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102911791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102911807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102911816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102911817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102911817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:15.062552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8986): Terminating (SIGTERM) 10:29:15.102702 run iperf3-srv_10.42.42.10(pid=8987): Terminating (SIGTERM) 10:29:15.142832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8988): Terminating (SIGTERM) 10:29:15.182771 run iperf3-srv_10.42.42.10(pid=8989): Terminating (SIGTERM) 10:29:15.222680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8990): Terminating (SIGTERM) 10:29:15.262659 run iperf3-srv_10.42.42.10(pid=8991): Terminating (SIGTERM) 10:29:15.302803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8992): Terminating (SIGTERM) 10:29:15.342804 run iperf3-srv_10.42.42.10(pid=8993): Terminating (SIGTERM) 10:29:15.382614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8996): Terminating (SIGTERM) 10:29:15.422793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8999): Terminating (SIGTERM) 10:29:15.462605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9002): Terminating (SIGTERM) 10:29:15.502719 --- ParallelTerminationStrategy: PID 8986 died... 10:29:15.521687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8986): Terminated: ok {rc=0} 10:29:15.565975 --- ParallelTerminationStrategy: PID 8987 died... 10:29:15.584865 run iperf3-srv_10.42.42.10(pid=8987): Terminated {rc=256} 10:29:15.629046 --- ParallelTerminationStrategy: PID 8988 died... 10:29:15.647806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8988): Terminated: ok {rc=0} 10:29:15.691828 --- ParallelTerminationStrategy: PID 8989 died... 10:29:15.710619 run iperf3-srv_10.42.42.10(pid=8989): Terminated {rc=256} 10:29:15.754747 --- ParallelTerminationStrategy: PID 8990 died... 10:29:15.773656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8990): Terminated: ok {rc=0} 10:29:15.817761 --- ParallelTerminationStrategy: PID 8991 died... 10:29:15.836479 run iperf3-srv_10.42.42.10(pid=8991): Terminated {rc=256} 10:29:15.896675 --- ParallelTerminationStrategy: PID 8992 died... 10:29:15.923918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8992): Terminated: ok {rc=0} 10:29:15.972814 --- ParallelTerminationStrategy: PID 8993 died... 10:29:15.996087 run iperf3-srv_10.42.42.10(pid=8993): Terminated {rc=256} 10:29:16.046193 --- ParallelTerminationStrategy: PID 8996 died... 10:29:16.067914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8996): Terminated: ok {rc=0} 10:29:16.117330 --- ParallelTerminationStrategy: PID 8999 died... 10:29:16.138639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8999): Terminated: ok {rc=0} 10:29:16.187989 --- ParallelTerminationStrategy: PID 9002 died... 10:29:16.210094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9002): Terminated: ok {rc=0} 10:29:16.303975 bus /gobi_4: Setting Powered False 10:29:17.407994 bus /gobi_4: Setting Powered False 10:29:18.526911 bus /gobi_1: Setting Powered False 10:29:19.627507 bus /gobi_1: Setting Powered False 10:29:20.744365 bus /gobi_0: Setting Powered False 10:29:21.844935 bus /gobi_0: Setting Powered False 10:29:22.959923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 10:29:24.064498 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:24.076218 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:29:24.128429 tst ping.py: using LAC 33319 10:29:24.249428 tst ping.py: using RAC 169 10:29:24.383566 tst ping.py: using CellId 33319 10:29:24.515530 tst ping.py: using BVCI 33320 10:29:24.636205 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:24.647763 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:24.658989 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:24.670206 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:24.681732 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:24.693128 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:24.704755 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:24.716175 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:29:24.837477 tst ping.py:19: start network... 10:29:25.058686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:25.568268 run create_hlr_db(pid=9004): Launched 10:29:25.694973 bus /gobi_6: Setting Powered False 10:29:26.759869 run create_hlr_db(pid=9004): Terminated: ok {rc=0} 10:29:27.202127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9006): Launched 10:29:27.512042 run osmo-hlr_10.42.42.2(pid=9007): Launched 10:29:27.631013 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:28.176697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9009): Launched 10:29:28.486366 run osmo-stp_10.42.42.5(pid=9010): Launched 10:29:28.604726 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:29:29.134971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9012): Launched 10:29:29.252325 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:29:29.514781 run patchelf(pid=9013): Launched 10:29:29.686776 run osmo-stp_10.42.42.5(pid=9010): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9010)] 10:29:29.817116 run osmo-stp_10.42.42.5(pid=9010): stdout: | (launched: 2022-12-13_10:29:28.427399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:29.948703 run osmo-stp_10.42.42.5(pid=9010): stderr: | 20221213102928598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102928598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102928599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102928599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102928599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102928600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102928600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:30.079362 run osmo-stp_10.42.42.5(pid=9010): stdout: | (launched: 2022-12-13_10:29:28.427399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:30.204907 run osmo-stp_10.42.42.5(pid=9010): stderr: | 20221213102928598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102928598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102928599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102928599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102928599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102928600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102928600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:30.353943 run patchelf(pid=9013): Terminating (SIGINT) 10:29:30.526239 run patchelf(pid=9013): Terminated: ok {rc=0} 10:29:30.649969 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9010): Process ended prematurely: osmo-stp_10.42.42.5(pid=9010) [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9010)] [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 10:29:30.658909 tst ping.py:22: Test FAILED (6.6 sec) 10:29:30.685879 run osmo-hlr_10.42.42.2(pid=9007): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9007)] 10:29:30.734258 run osmo-hlr_10.42.42.2(pid=9007): stdout: | (launched: 2022-12-13_10:29:27.453291) 10:29:30.784062 run osmo-hlr_10.42.42.2(pid=9007): stderr: | 20221213102927630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102927630 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102927630 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102927630 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102927630 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102927630 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102927642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102927651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102927651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102927651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:30.834322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9006): Terminating (SIGTERM) 10:29:30.876873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9009): Terminating (SIGTERM) 10:29:30.938793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9012): Terminating (SIGTERM) 10:29:30.981998 --- ParallelTerminationStrategy: PID 9006 died... 10:29:31.001906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9006): Terminated: ok {rc=0} 10:29:31.047669 --- ParallelTerminationStrategy: PID 9009 died... 10:29:31.070540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9009): Terminated: ok {rc=0} 10:29:31.127323 --- ParallelTerminationStrategy: PID 9012 died... 10:29:31.151028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9012): Terminated: ok {rc=0} 10:29:31.255297 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:29:32.351583 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:32.364158 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:29:32.422422 tst ping_idle_ping.py: using LAC 33320 10:29:32.550741 tst ping_idle_ping.py: using RAC 170 10:29:32.678787 tst ping_idle_ping.py: using CellId 33320 10:29:32.805795 tst ping_idle_ping.py: using BVCI 33321 10:29:32.927566 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:32.939098 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:32.950410 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:32.961660 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:32.973660 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:32.985606 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:32.997851 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:33.010055 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:29:33.129302 tst ping_idle_ping.py:24: start network... 10:29:33.335537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:33.818367 run create_hlr_db(pid=9014): Launched 10:29:33.945972 bus /gobi_6: Setting Powered False 10:29:35.007547 run create_hlr_db(pid=9014): Terminated: ok {rc=0} 10:29:35.461105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9016): Launched 10:29:35.795689 run osmo-hlr_10.42.42.2(pid=9017): Launched 10:29:35.922725 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:36.491760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9019): Launched 10:29:36.826276 run osmo-stp_10.42.42.5(pid=9020): Launched 10:29:36.953232 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:29:37.524517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9022): Launched 10:29:37.651335 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:29:37.933369 run patchelf(pid=9023): Launched 10:29:38.117501 run osmo-stp_10.42.42.5(pid=9020): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9020)] 10:29:38.256857 run osmo-stp_10.42.42.5(pid=9020): stdout: | (launched: 2022-12-13_10:29:36.763484) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:38.397481 run osmo-stp_10.42.42.5(pid=9020): stderr: | 20221213102936956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102936956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102936956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102936957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102936957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102936957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102936957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:38.538258 run osmo-stp_10.42.42.5(pid=9020): stdout: | (launched: 2022-12-13_10:29:36.763484) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:38.673828 run osmo-stp_10.42.42.5(pid=9020): stderr: | 20221213102936956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102936956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102936956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102936957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102936957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102936957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102936957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:38.834025 run patchelf(pid=9023): Terminating (SIGINT) 10:29:39.019074 run patchelf(pid=9023): Terminated: ok {rc=0} 10:29:39.152546 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9020): Process ended prematurely: osmo-stp_10.42.42.5(pid=9020) [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9020)] [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 10:29:39.162277 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:29:39.190700 run osmo-hlr_10.42.42.2(pid=9017): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9017)] 10:29:39.242229 run osmo-hlr_10.42.42.2(pid=9017): stdout: | (launched: 2022-12-13_10:29:35.733202) 10:29:39.294760 run osmo-hlr_10.42.42.2(pid=9017): stderr: | 20221213102935930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102935930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102935930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102935931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102935931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102935931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102935948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102935958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102935958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102935958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:39.347968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9016): Terminating (SIGTERM) 10:29:39.390528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9019): Terminating (SIGTERM) 10:29:39.433147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9022): Terminating (SIGTERM) 10:29:39.476549 --- ParallelTerminationStrategy: PID 9016 died... 10:29:39.497304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9016): Terminated: ok {rc=0} 10:29:39.544447 --- ParallelTerminationStrategy: PID 9019 died... 10:29:39.564530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9019): Terminated: ok {rc=0} 10:29:39.611962 --- ParallelTerminationStrategy: PID 9022 died... 10:29:39.632243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9022): Terminated: ok {rc=0} 10:29:39.722355 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:29:41.039432 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:29:41.045944 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:29:41.079817 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:29:41.120222 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:29:41.210075 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:29:41.243721 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:29:41.283039 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:29:41.879318 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:29:41.933749 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:41.945100 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:29:42.016690 tst cs_paging_gprs_active.py: using LAC 33321 10:29:42.147679 tst cs_paging_gprs_active.py: using RAC 171 10:29:42.279566 tst cs_paging_gprs_active.py: using CellId 33321 10:29:42.410485 tst cs_paging_gprs_active.py: using BVCI 33322 10:29:42.531927 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:42.543333 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:42.554652 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:42.565878 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:42.577601 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:42.589097 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:42.600653 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:42.612086 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:42.623643 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:29:42.743480 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:29:42.866362 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:29:43.093851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:43.432540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9029): Launched 10:29:43.726911 run iperf3-srv_10.42.42.10(pid=9030): Launched 10:29:43.852035 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:29:44.078060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:44.415703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9031): Launched 10:29:44.710501 run iperf3-srv_10.42.42.10(pid=9032): Launched 10:29:44.837253 tst cs_paging_gprs_active.py:38: start network... 10:29:45.063341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:45.583775 run create_hlr_db(pid=9033): Launched 10:29:45.713984 bus /gobi_6: Setting Powered False 10:29:46.788289 run create_hlr_db(pid=9033): Terminated: ok {rc=0} 10:29:47.271084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9036): Launched 10:29:47.586736 run osmo-hlr_10.42.42.2(pid=9037): Launched 10:29:47.706411 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:48.259784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9039): Launched 10:29:48.574665 run osmo-stp_10.42.42.5(pid=9040): Launched 10:29:48.695111 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:29:49.234348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9042): Launched 10:29:49.355761 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:29:49.621588 run patchelf(pid=9043): Launched 10:29:49.795129 run osmo-stp_10.42.42.5(pid=9040): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9040)] 10:29:49.927682 run osmo-stp_10.42.42.5(pid=9040): stdout: | (launched: 2022-12-13_10:29:48.515254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:50.060911 run osmo-stp_10.42.42.5(pid=9040): stderr: | 20221213102948687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102948687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102948687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102948688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102948688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102948689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102948689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:50.193956 run osmo-stp_10.42.42.5(pid=9040): stdout: | (launched: 2022-12-13_10:29:48.515254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:50.321515 run osmo-stp_10.42.42.5(pid=9040): stderr: | 20221213102948687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213102948687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213102948687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213102948688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213102948688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213102948689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213102948689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:50.472247 run patchelf(pid=9043): Terminating (SIGINT) 10:29:50.648617 run patchelf(pid=9043): Terminated: ok {rc=0} 10:29:50.775140 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9040): Process ended prematurely: osmo-stp_10.42.42.5(pid=9040) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9040)] [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:29:50.784625 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 10:29:50.811988 run osmo-hlr_10.42.42.2(pid=9037): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9037)] 10:29:50.860137 run osmo-hlr_10.42.42.2(pid=9037): stdout: | (launched: 2022-12-13_10:29:47.527414) 10:29:50.910244 run osmo-hlr_10.42.42.2(pid=9037): stderr: | 20221213102947704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102947704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102947704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102947704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102947704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102947705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102947717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102947726 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102947726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102947726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:50.960201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9029): Terminating (SIGTERM) 10:29:51.000552 run iperf3-srv_10.42.42.10(pid=9030): Terminating (SIGTERM) 10:29:51.041030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9031): Terminating (SIGTERM) 10:29:51.082543 run iperf3-srv_10.42.42.10(pid=9032): Terminating (SIGTERM) 10:29:51.122782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9036): Terminating (SIGTERM) 10:29:51.162923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9039): Terminating (SIGTERM) 10:29:51.202901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9042): Terminating (SIGTERM) 10:29:51.243257 --- ParallelTerminationStrategy: PID 9029 died... 10:29:51.262687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9029): Terminated: ok {rc=0} 10:29:51.307563 --- ParallelTerminationStrategy: PID 9030 died... 10:29:51.326294 run iperf3-srv_10.42.42.10(pid=9030): Terminated {rc=256} 10:29:51.370327 --- ParallelTerminationStrategy: PID 9031 died... 10:29:51.388993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9031): Terminated: ok {rc=0} 10:29:51.432877 --- ParallelTerminationStrategy: PID 9032 died... 10:29:51.451563 run iperf3-srv_10.42.42.10(pid=9032): Terminated {rc=256} 10:29:51.495531 --- ParallelTerminationStrategy: PID 9036 died... 10:29:51.514306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9036): Terminated: ok {rc=0} 10:29:51.558474 --- ParallelTerminationStrategy: PID 9039 died... 10:29:51.577542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9039): Terminated: ok {rc=0} 10:29:51.621646 --- ParallelTerminationStrategy: PID 9042 died... 10:29:51.640318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9042): Terminated: ok {rc=0} 10:29:51.727699 bus /gobi_0: Setting Powered False 10:29:52.829256 bus /gobi_0: Setting Powered False 10:29:53.945868 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:29:55.094696 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:55.106287 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:29:55.179253 tst iperf3.py: using LAC 33322 10:29:55.302854 tst iperf3.py: using RAC 172 10:29:55.426826 tst iperf3.py: using CellId 33322 10:29:55.550652 tst iperf3.py: using BVCI 33323 10:29:55.665225 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:55.676092 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:55.686811 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:55.697521 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:55.708106 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:55.718854 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:55.730077 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:55.740784 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:55.751745 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:29:55.872638 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:29:56.098635 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:56.435953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9044): Launched 10:29:56.729015 run iperf3-srv_10.42.42.10(pid=9045): Launched 10:29:56.855440 tst iperf3.py:8: start network... 10:29:57.081361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:57.601327 run create_hlr_db(pid=9046): Launched 10:29:57.735101 bus /gobi_6: Setting Powered False 10:29:58.800874 run create_hlr_db(pid=9046): Terminated: ok {rc=0} 10:29:59.248134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9048): Launched 10:29:59.562161 run osmo-hlr_10.42.42.2(pid=9049): Launched 10:29:59.681170 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:00.230305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9051): Launched 10:30:00.543975 run osmo-stp_10.42.42.5(pid=9052): Launched 10:30:00.664744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:01.257358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9054): Launched 10:30:01.397989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:01.693015 run patchelf(pid=9055): Launched 10:30:01.914665 run osmo-stp_10.42.42.5(pid=9052): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9052)] 10:30:02.075894 run osmo-stp_10.42.42.5(pid=9052): stdout: | (launched: 2022-12-13_10:30:00.484163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:02.223752 run osmo-stp_10.42.42.5(pid=9052): stderr: | 20221213103000655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103000655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103000656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103000656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103000657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103000657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103000657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:02.370666 run osmo-stp_10.42.42.5(pid=9052): stdout: | (launched: 2022-12-13_10:30:00.484163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:02.508250 run osmo-stp_10.42.42.5(pid=9052): stderr: | 20221213103000655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103000655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103000656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103000656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103000657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103000657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103000657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:02.672033 run patchelf(pid=9055): Terminating (SIGINT) 10:30:02.860184 run patchelf(pid=9055): Terminated: ok {rc=0} 10:30:02.996331 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9052): Process ended prematurely: osmo-stp_10.42.42.5(pid=9052) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9052)] [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 10:30:03.006691 tst iperf3.py:8: Test FAILED (7.9 sec) 10:30:03.035998 run osmo-hlr_10.42.42.2(pid=9049): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9049)] 10:30:03.088489 run osmo-hlr_10.42.42.2(pid=9049): stdout: | (launched: 2022-12-13_10:29:59.502842) 10:30:03.142466 run osmo-hlr_10.42.42.2(pid=9049): stderr: | 20221213102959680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213102959680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213102959680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213102959680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213102959680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213102959680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213102959692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213102959703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213102959703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213102959703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:03.196818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9044): Terminating (SIGTERM) 10:30:03.239903 run iperf3-srv_10.42.42.10(pid=9045): Terminating (SIGTERM) 10:30:03.283211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9048): Terminating (SIGTERM) 10:30:03.326866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9051): Terminating (SIGTERM) 10:30:03.370140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9054): Terminating (SIGTERM) 10:30:03.413692 --- ParallelTerminationStrategy: PID 9044 died... 10:30:03.434786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9044): Terminated: ok {rc=0} 10:30:03.482483 --- ParallelTerminationStrategy: PID 9045 died... 10:30:03.502853 run iperf3-srv_10.42.42.10(pid=9045): Terminated {rc=256} 10:30:03.550154 --- ParallelTerminationStrategy: PID 9048 died... 10:30:03.570429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9048): Terminated: ok {rc=0} 10:30:03.618295 --- ParallelTerminationStrategy: PID 9051 died... 10:30:03.638865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9051): Terminated: ok {rc=0} 10:30:03.686276 --- ParallelTerminationStrategy: PID 9054 died... 10:30:03.706700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9054): Terminated: ok {rc=0} 10:30:03.797073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:30:04.951839 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:04.964100 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:30:05.036596 tst iperf3m4.py: using LAC 33323 10:30:05.166745 tst iperf3m4.py: using RAC 173 10:30:05.298477 tst iperf3m4.py: using CellId 33323 10:30:05.429181 tst iperf3m4.py: using BVCI 33324 10:30:05.552168 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:05.563595 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:05.574872 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:05.586491 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:05.597957 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:05.609614 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:05.621287 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:05.632663 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:05.644467 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:30:05.765710 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:30:05.886356 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:30:06.010606 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:30:06.130788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:30:06.341705 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:06.658410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9059): Launched 10:30:06.933739 run iperf3-srv_10.42.42.10(pid=9060): Launched 10:30:07.052659 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:30:07.261281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:07.575734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9061): Launched 10:30:07.851058 run iperf3-srv_10.42.42.10(pid=9062): Launched 10:30:07.969648 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:30:08.179848 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:08.495665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9063): Launched 10:30:08.770882 run iperf3-srv_10.42.42.10(pid=9064): Launched 10:30:08.889148 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:30:09.097167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:09.412200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9065): Launched 10:30:09.688420 run iperf3-srv_10.42.42.10(pid=9066): Launched 10:30:09.806645 tst iperf3m4.py:8: start network... 10:30:10.016225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:10.501707 run create_hlr_db(pid=9067): Launched 10:30:10.630023 bus /gobi_6: Setting Powered False 10:30:11.691543 run create_hlr_db(pid=9067): Terminated: ok {rc=0} 10:30:12.149498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9069): Launched 10:30:12.486470 run osmo-hlr_10.42.42.2(pid=9070): Launched 10:30:12.616337 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:13.196272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9072): Launched 10:30:13.534575 run osmo-stp_10.42.42.5(pid=9073): Launched 10:30:13.664295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:14.243716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9075): Launched 10:30:14.373133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:14.659078 run patchelf(pid=9076): Launched 10:30:14.845658 run osmo-stp_10.42.42.5(pid=9073): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9073)] 10:30:14.986784 run osmo-stp_10.42.42.5(pid=9073): stdout: | (launched: 2022-12-13_10:30:13.471091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:15.129331 run osmo-stp_10.42.42.5(pid=9073): stderr: | 20221213103013664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103013664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103013665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103013665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103013666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103013666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103013666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:15.271756 run osmo-stp_10.42.42.5(pid=9073): stdout: | (launched: 2022-12-13_10:30:13.471091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:15.408667 run osmo-stp_10.42.42.5(pid=9073): stderr: | 20221213103013664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103013664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103013665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103013665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103013666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103013666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103013666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:15.571058 run patchelf(pid=9076): Terminating (SIGINT) 10:30:15.758931 run patchelf(pid=9076): Terminated: ok {rc=0} 10:30:15.895441 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9073): Process ended prematurely: osmo-stp_10.42.42.5(pid=9073) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9073)] [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:30:15.906324 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:30:15.935990 run osmo-hlr_10.42.42.2(pid=9070): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9070)] 10:30:15.989707 run osmo-hlr_10.42.42.2(pid=9070): stdout: | (launched: 2022-12-13_10:30:12.423361) 10:30:16.043833 run osmo-hlr_10.42.42.2(pid=9070): stderr: | 20221213103012621 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103012621 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103012621 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103012621 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103012621 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103012621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103012633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103012643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103012643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103012643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:16.098954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9059): Terminating (SIGTERM) 10:30:16.143108 run iperf3-srv_10.42.42.10(pid=9060): Terminating (SIGTERM) 10:30:16.190669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9061): Terminating (SIGTERM) 10:30:16.236066 run iperf3-srv_10.42.42.10(pid=9062): Terminating (SIGTERM) 10:30:16.283583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9063): Terminating (SIGTERM) 10:30:16.329104 run iperf3-srv_10.42.42.10(pid=9064): Terminating (SIGTERM) 10:30:16.376370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9065): Terminating (SIGTERM) 10:30:16.421983 run iperf3-srv_10.42.42.10(pid=9066): Terminating (SIGTERM) 10:30:16.469743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9069): Terminating (SIGTERM) 10:30:16.515353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9072): Terminating (SIGTERM) 10:30:16.561784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9075): Terminating (SIGTERM) 10:30:16.607261 --- ParallelTerminationStrategy: PID 9059 died... 10:30:16.629630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9059): Terminated: ok {rc=0} 10:30:16.680073 --- ParallelTerminationStrategy: PID 9060 died... 10:30:16.701082 run iperf3-srv_10.42.42.10(pid=9060): Terminated {rc=256} 10:30:16.749745 --- ParallelTerminationStrategy: PID 9061 died... 10:30:16.771588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9061): Terminated: ok {rc=0} 10:30:16.820398 --- ParallelTerminationStrategy: PID 9062 died... 10:30:16.842103 run iperf3-srv_10.42.42.10(pid=9062): Terminated {rc=256} 10:30:16.891061 --- ParallelTerminationStrategy: PID 9063 died... 10:30:16.912543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9063): Terminated: ok {rc=0} 10:30:16.961477 --- ParallelTerminationStrategy: PID 9064 died... 10:30:16.983135 run iperf3-srv_10.42.42.10(pid=9064): Terminated {rc=256} 10:30:17.031997 --- ParallelTerminationStrategy: PID 9065 died... 10:30:17.058041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9065): Terminated: ok {rc=0} 10:30:17.114176 --- ParallelTerminationStrategy: PID 9066 died... 10:30:17.134746 run iperf3-srv_10.42.42.10(pid=9066): Terminated {rc=256} 10:30:17.180690 --- ParallelTerminationStrategy: PID 9069 died... 10:30:17.200220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9069): Terminated: ok {rc=0} 10:30:17.245336 --- ParallelTerminationStrategy: PID 9072 died... 10:30:17.264234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9072): Terminated: ok {rc=0} 10:30:17.308400 --- ParallelTerminationStrategy: PID 9075 died... 10:30:17.327414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9075): Terminated: ok {rc=0} 10:30:17.414753 bus /gobi_4: Setting Powered False 10:30:18.514879 bus /gobi_4: Setting Powered False 10:30:19.631366 bus /gobi_1: Setting Powered False 10:30:20.732910 bus /gobi_1: Setting Powered False 10:30:21.851087 bus /gobi_0: Setting Powered False 10:30:22.950536 bus /gobi_0: Setting Powered False 10:30:24.070788 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:30:25.174240 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:25.186094 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:30:25.256216 tst ping.py: using LAC 33324 10:30:25.377542 tst ping.py: using RAC 174 10:30:25.500656 tst ping.py: using CellId 33324 10:30:25.622523 tst ping.py: using BVCI 33325 10:30:25.735226 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:25.746332 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:25.757137 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:25.767888 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:25.778590 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:25.789292 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:25.801099 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:25.811848 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:30:25.928561 tst ping.py:19: start network... 10:30:26.135491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:26.613850 run create_hlr_db(pid=9077): Launched 10:30:26.738956 bus /gobi_6: Setting Powered False 10:30:27.799647 run create_hlr_db(pid=9077): Terminated: ok {rc=0} 10:30:28.252455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9079): Launched 10:30:28.585450 run osmo-hlr_10.42.42.2(pid=9080): Launched 10:30:28.712610 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:29.287067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9082): Launched 10:30:29.619423 run osmo-stp_10.42.42.5(pid=9083): Launched 10:30:29.745060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:30.315309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9085): Launched 10:30:30.442868 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:30.723372 run patchelf(pid=9086): Launched 10:30:30.918743 run osmo-stp_10.42.42.5(pid=9083): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9083)] 10:30:31.064023 run osmo-stp_10.42.42.5(pid=9083): stdout: | (launched: 2022-12-13_10:30:29.556312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:31.199209 run osmo-stp_10.42.42.5(pid=9083): stderr: | 20221213103029747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103029747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103029748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103029748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103029749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103029749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103029749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:31.335469 run osmo-stp_10.42.42.5(pid=9083): stdout: | (launched: 2022-12-13_10:30:29.556312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:31.466540 run osmo-stp_10.42.42.5(pid=9083): stderr: | 20221213103029747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103029747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103029748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103029748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103029749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103029749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103029749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:31.620246 run patchelf(pid=9086): Terminating (SIGINT) 10:30:31.799583 run patchelf(pid=9086): Terminated: ok {rc=0} 10:30:31.929899 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9083): Process ended prematurely: osmo-stp_10.42.42.5(pid=9083) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9083)] [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 10:30:31.939580 tst ping.py:22: Test FAILED (6.8 sec) 10:30:31.967757 run osmo-hlr_10.42.42.2(pid=9080): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9080)] 10:30:32.018118 run osmo-hlr_10.42.42.2(pid=9080): stdout: | (launched: 2022-12-13_10:30:28.523138) 10:30:32.071888 run osmo-hlr_10.42.42.2(pid=9080): stderr: | 20221213103028719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103028719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103028719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103028719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103028719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103028719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103028731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103028740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103028740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103028740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:32.125336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9079): Terminating (SIGTERM) 10:30:32.167874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9082): Terminating (SIGTERM) 10:30:32.211891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9085): Terminating (SIGTERM) 10:30:32.253482 --- ParallelTerminationStrategy: PID 9079 died... 10:30:32.273401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9079): Terminated: ok {rc=0} 10:30:32.318793 --- ParallelTerminationStrategy: PID 9082 died... 10:30:32.338087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9082): Terminated: ok {rc=0} 10:30:32.383059 --- ParallelTerminationStrategy: PID 9085 died... 10:30:32.402472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9085): Terminated: ok {rc=0} 10:30:32.488600 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:30:33.577728 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:33.590424 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:30:33.664574 tst ping_idle_ping.py: using LAC 33325 10:30:33.794421 tst ping_idle_ping.py: using RAC 175 10:30:33.924816 tst ping_idle_ping.py: using CellId 33325 10:30:34.054440 tst ping_idle_ping.py: using BVCI 33326 10:30:34.175543 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:34.187235 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:34.198617 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:34.210238 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:34.221809 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:34.233476 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:34.245206 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:34.256711 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:30:34.379495 tst ping_idle_ping.py:24: start network... 10:30:34.603323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:35.125495 run create_hlr_db(pid=9087): Launched 10:30:35.251812 bus /gobi_6: Setting Powered False 10:30:36.316486 run create_hlr_db(pid=9087): Terminated: ok {rc=0} 10:30:36.759466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9089): Launched 10:30:37.070264 run osmo-hlr_10.42.42.2(pid=9090): Launched 10:30:37.188007 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:37.719398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9092): Launched 10:30:38.029462 run osmo-stp_10.42.42.5(pid=9093): Launched 10:30:38.146352 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:38.678746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9095): Launched 10:30:38.795856 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:39.057419 run patchelf(pid=9096): Launched 10:30:39.227752 run osmo-stp_10.42.42.5(pid=9093): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9093)] 10:30:39.357990 run osmo-stp_10.42.42.5(pid=9093): stdout: | (launched: 2022-12-13_10:30:37.971032) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:39.489266 run osmo-stp_10.42.42.5(pid=9093): stderr: | 20221213103038142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103038142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103038142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103038142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103038143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103038143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103038143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:39.620239 run osmo-stp_10.42.42.5(pid=9093): stdout: | (launched: 2022-12-13_10:30:37.971032) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:39.745768 run osmo-stp_10.42.42.5(pid=9093): stderr: | 20221213103038142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103038142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103038142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103038142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103038143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103038143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103038143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:39.894549 run patchelf(pid=9096): Terminating (SIGINT) 10:30:40.066652 run patchelf(pid=9096): Terminated: ok {rc=0} 10:30:40.191040 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9093): Process ended prematurely: osmo-stp_10.42.42.5(pid=9093) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9093)] [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:30:40.199919 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:30:40.226665 run osmo-hlr_10.42.42.2(pid=9090): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9090)] 10:30:40.275405 run osmo-hlr_10.42.42.2(pid=9090): stdout: | (launched: 2022-12-13_10:30:37.011515) 10:30:40.325135 run osmo-hlr_10.42.42.2(pid=9090): stderr: | 20221213103037185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103037185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103037185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103037185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103037185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103037185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103037198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103037206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103037207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103037207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:40.375244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9089): Terminating (SIGTERM) 10:30:40.415188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9092): Terminating (SIGTERM) 10:30:40.455101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9095): Terminating (SIGTERM) 10:30:40.495469 --- ParallelTerminationStrategy: PID 9089 died... 10:30:40.514872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9089): Terminated: ok {rc=0} 10:30:40.559019 --- ParallelTerminationStrategy: PID 9092 died... 10:30:40.577935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9092): Terminated: ok {rc=0} 10:30:40.622052 --- ParallelTerminationStrategy: PID 9095 died... 10:30:40.640668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9095): Terminated: ok {rc=0} 10:30:40.724916 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:30:42.033716 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:30:42.040554 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:30:42.074701 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:30:42.114925 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:30:42.205519 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:30:42.239731 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:30:42.279096 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:30:42.868937 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:30:42.919519 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:42.930678 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:30:43.000301 tst cs_paging_gprs_active.py: using LAC 33326 10:30:43.124400 tst cs_paging_gprs_active.py: using RAC 176 10:30:43.246258 tst cs_paging_gprs_active.py: using CellId 33326 10:30:43.370888 tst cs_paging_gprs_active.py: using BVCI 33327 10:30:43.486455 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:43.497426 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:43.508129 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:43.518869 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:43.529556 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:43.540308 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:43.551102 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:43.561751 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:43.572510 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:30:43.696549 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:30:43.817136 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:30:44.027903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:44.344616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9102): Launched 10:30:44.620520 run iperf3-srv_10.42.42.10(pid=9103): Launched 10:30:44.739180 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:30:44.948440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:45.263991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9104): Launched 10:30:45.540118 run iperf3-srv_10.42.42.10(pid=9105): Launched 10:30:45.658461 tst cs_paging_gprs_active.py:38: start network... 10:30:45.876855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:46.384336 run create_hlr_db(pid=9106): Launched 10:30:46.520403 bus /gobi_6: Setting Powered False 10:30:47.585458 run create_hlr_db(pid=9106): Terminated: ok {rc=0} 10:30:48.038522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9108): Launched 10:30:48.353264 run osmo-hlr_10.42.42.2(pid=9109): Launched 10:30:48.473125 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:49.011580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9111): Launched 10:30:49.326974 run osmo-stp_10.42.42.5(pid=9112): Launched 10:30:49.447485 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:49.987206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9114): Launched 10:30:50.106591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:50.373966 run patchelf(pid=9115): Launched 10:30:50.547820 run osmo-stp_10.42.42.5(pid=9112): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9112)] 10:30:50.679870 run osmo-stp_10.42.42.5(pid=9112): stdout: | (launched: 2022-12-13_10:30:49.267348) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:50.813197 run osmo-stp_10.42.42.5(pid=9112): stderr: | 20221213103049439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103049439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103049439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103049439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103049440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103049440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103049440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:50.946620 run osmo-stp_10.42.42.5(pid=9112): stdout: | (launched: 2022-12-13_10:30:49.267348) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:51.074485 run osmo-stp_10.42.42.5(pid=9112): stderr: | 20221213103049439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103049439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103049439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103049439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103049440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103049440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103049440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:51.226456 run patchelf(pid=9115): Terminating (SIGINT) 10:30:51.402425 run patchelf(pid=9115): Terminated: ok {rc=0} 10:30:51.528811 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9112): Process ended prematurely: osmo-stp_10.42.42.5(pid=9112) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9112)] [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:30:51.538462 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:30:51.565513 run osmo-hlr_10.42.42.2(pid=9109): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9109)] 10:30:51.613283 run osmo-hlr_10.42.42.2(pid=9109): stdout: | (launched: 2022-12-13_10:30:48.293257) 10:30:51.662789 run osmo-hlr_10.42.42.2(pid=9109): stderr: | 20221213103048470 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103048470 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103048470 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103048471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103048471 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103048471 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103048486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103048494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103048494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103048494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:51.712553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9102): Terminating (SIGTERM) 10:30:51.752520 run iperf3-srv_10.42.42.10(pid=9103): Terminating (SIGTERM) 10:30:51.792367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9104): Terminating (SIGTERM) 10:30:51.833166 run iperf3-srv_10.42.42.10(pid=9105): Terminating (SIGTERM) 10:30:51.875196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9108): Terminating (SIGTERM) 10:30:51.915929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9111): Terminating (SIGTERM) 10:30:51.955494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9114): Terminating (SIGTERM) 10:30:51.995282 --- ParallelTerminationStrategy: PID 9102 died... 10:30:52.014253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9102): Terminated: ok {rc=0} 10:30:52.058038 --- ParallelTerminationStrategy: PID 9103 died... 10:30:52.076398 run iperf3-srv_10.42.42.10(pid=9103): Terminated {rc=256} 10:30:52.120005 --- ParallelTerminationStrategy: PID 9104 died... 10:30:52.138736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9104): Terminated: ok {rc=0} 10:30:52.182329 --- ParallelTerminationStrategy: PID 9105 died... 10:30:52.200657 run iperf3-srv_10.42.42.10(pid=9105): Terminated {rc=256} 10:30:52.244495 --- ParallelTerminationStrategy: PID 9108 died... 10:30:52.263062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9108): Terminated: ok {rc=0} 10:30:52.306881 --- ParallelTerminationStrategy: PID 9111 died... 10:30:52.325464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9111): Terminated: ok {rc=0} 10:30:52.369722 --- ParallelTerminationStrategy: PID 9114 died... 10:30:52.388100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9114): Terminated: ok {rc=0} 10:30:52.473825 bus /gobi_0: Setting Powered False 10:30:53.573814 bus /gobi_0: Setting Powered False 10:30:54.688833 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:30:55.837448 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:55.849288 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:30:55.922218 tst iperf3.py: using LAC 33327 10:30:56.048438 tst iperf3.py: using RAC 177 10:30:56.170313 tst iperf3.py: using CellId 33327 10:30:56.290229 tst iperf3.py: using BVCI 33328 10:30:56.403923 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:56.414946 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:56.425804 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:56.436609 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:56.447379 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:56.458211 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:56.469044 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:56.479884 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:56.490845 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:30:56.608709 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:30:56.818807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:57.134867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9119): Launched 10:30:57.408553 run iperf3-srv_10.42.42.10(pid=9120): Launched 10:30:57.527788 tst iperf3.py:8: start network... 10:30:57.736770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:58.220650 run create_hlr_db(pid=9121): Launched 10:30:58.348030 bus /gobi_6: Setting Powered False 10:30:59.410247 run create_hlr_db(pid=9121): Terminated: ok {rc=0} 10:30:59.867653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9123): Launched 10:31:00.203665 run osmo-hlr_10.42.42.2(pid=9124): Launched 10:31:00.332927 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:00.936603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9126): Launched 10:31:01.286376 run osmo-stp_10.42.42.5(pid=9127): Launched 10:31:01.477283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:02.193782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9129): Launched 10:31:02.326089 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:02.611853 run patchelf(pid=9130): Launched 10:31:02.797612 run osmo-stp_10.42.42.5(pid=9127): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9127)] 10:31:02.938924 run osmo-stp_10.42.42.5(pid=9127): stdout: | (launched: 2022-12-13_10:31:01.224566) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:03.081391 run osmo-stp_10.42.42.5(pid=9127): stderr: | 20221213103101566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103101566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103101566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103101567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103101567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103101567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103101567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:03.224054 run osmo-stp_10.42.42.5(pid=9127): stdout: | (launched: 2022-12-13_10:31:01.224566) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:03.361304 run osmo-stp_10.42.42.5(pid=9127): stderr: | 20221213103101566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103101566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103101566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103101567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103101567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103101567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103101567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:03.523379 run patchelf(pid=9130): Terminating (SIGINT) 10:31:03.710902 run patchelf(pid=9130): Terminated: ok {rc=0} 10:31:03.845838 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9127): Process ended prematurely: osmo-stp_10.42.42.5(pid=9127) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9127)] [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 10:31:03.856111 tst iperf3.py:8: Test FAILED (8.1 sec) 10:31:03.884854 run osmo-hlr_10.42.42.2(pid=9124): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9124)] 10:31:03.936057 run osmo-hlr_10.42.42.2(pid=9124): stdout: | (launched: 2022-12-13_10:31:00.140693) 10:31:03.988649 run osmo-hlr_10.42.42.2(pid=9124): stderr: | 20221213103100338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103100338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103100338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103100338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103100338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103100339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103100351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103100361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103100361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103100362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:04.042128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9119): Terminating (SIGTERM) 10:31:04.084913 run iperf3-srv_10.42.42.10(pid=9120): Terminating (SIGTERM) 10:31:04.127586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9123): Terminating (SIGTERM) 10:31:04.170395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9126): Terminating (SIGTERM) 10:31:04.212903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9129): Terminating (SIGTERM) 10:31:04.256297 --- ParallelTerminationStrategy: PID 9119 died... 10:31:04.277093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9119): Terminated: ok {rc=0} 10:31:04.324058 --- ParallelTerminationStrategy: PID 9120 died... 10:31:04.344236 run iperf3-srv_10.42.42.10(pid=9120): Terminated {rc=256} 10:31:04.390882 --- ParallelTerminationStrategy: PID 9123 died... 10:31:04.411020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9123): Terminated: ok {rc=0} 10:31:04.457925 --- ParallelTerminationStrategy: PID 9126 died... 10:31:04.478065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9126): Terminated: ok {rc=0} 10:31:04.525160 --- ParallelTerminationStrategy: PID 9129 died... 10:31:04.545210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9129): Terminated: ok {rc=0} 10:31:04.634650 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:31:05.790015 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:05.802411 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:31:05.875031 tst iperf3m4.py: using LAC 33328 10:31:06.007844 tst iperf3m4.py: using RAC 178 10:31:06.141423 tst iperf3m4.py: using CellId 33328 10:31:06.271399 tst iperf3m4.py: using BVCI 33329 10:31:06.393040 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:06.404368 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:06.415715 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:06.427008 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:06.438471 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:06.450157 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:06.461895 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:06.473460 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:06.485383 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:31:06.605768 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:31:06.733393 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:31:06.857335 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:31:06.977720 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:31:07.188529 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:07.505436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9131): Launched 10:31:07.778817 run iperf3-srv_10.42.42.10(pid=9132): Launched 10:31:07.897074 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:31:08.106234 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:08.421705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9133): Launched 10:31:08.697381 run iperf3-srv_10.42.42.10(pid=9134): Launched 10:31:08.816254 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:31:09.024889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:09.340368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9135): Launched 10:31:09.616529 run iperf3-srv_10.42.42.10(pid=9136): Launched 10:31:09.734797 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:31:09.944238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:10.259557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9137): Launched 10:31:10.535271 run iperf3-srv_10.42.42.10(pid=9138): Launched 10:31:10.654163 tst iperf3m4.py:8: start network... 10:31:10.863053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:11.348754 run create_hlr_db(pid=9139): Launched 10:31:11.477378 bus /gobi_6: Setting Powered False 10:31:12.540031 run create_hlr_db(pid=9139): Terminated: ok {rc=0} 10:31:12.976903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9141): Launched 10:31:13.292577 run osmo-hlr_10.42.42.2(pid=9142): Launched 10:31:13.413337 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:13.950499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9144): Launched 10:31:14.263714 run osmo-stp_10.42.42.5(pid=9145): Launched 10:31:14.383716 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:14.922348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9147): Launched 10:31:15.042933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:15.308527 run patchelf(pid=9148): Launched 10:31:15.483225 run osmo-stp_10.42.42.5(pid=9145): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9145)] 10:31:15.615225 run osmo-stp_10.42.42.5(pid=9145): stdout: | (launched: 2022-12-13_10:31:14.204142) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:15.748454 run osmo-stp_10.42.42.5(pid=9145): stderr: | 20221213103114374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103114375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103114375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103114375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103114376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103114376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103114376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:15.895409 run osmo-stp_10.42.42.5(pid=9145): stdout: | (launched: 2022-12-13_10:31:14.204142) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:16.026260 run osmo-stp_10.42.42.5(pid=9145): stderr: | 20221213103114374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103114375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103114375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103114375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103114376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103114376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103114376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:16.180339 run patchelf(pid=9148): Terminating (SIGINT) 10:31:16.382380 run patchelf(pid=9148): Terminated: ok {rc=0} 10:31:16.517433 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9145): Process ended prematurely: osmo-stp_10.42.42.5(pid=9145) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9145)] [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:31:16.528750 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:31:16.558585 run osmo-hlr_10.42.42.2(pid=9142): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9142)] 10:31:16.611573 run osmo-hlr_10.42.42.2(pid=9142): stdout: | (launched: 2022-12-13_10:31:13.232841) 10:31:16.664356 run osmo-hlr_10.42.42.2(pid=9142): stderr: | 20221213103113410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103113411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103113411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103113411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103113411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103113411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103113426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103113434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103113434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103113434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:16.718448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9131): Terminating (SIGTERM) 10:31:16.760811 run iperf3-srv_10.42.42.10(pid=9132): Terminating (SIGTERM) 10:31:16.805371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9133): Terminating (SIGTERM) 10:31:16.850397 run iperf3-srv_10.42.42.10(pid=9134): Terminating (SIGTERM) 10:31:16.895078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9135): Terminating (SIGTERM) 10:31:16.938520 run iperf3-srv_10.42.42.10(pid=9136): Terminating (SIGTERM) 10:31:16.981419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9137): Terminating (SIGTERM) 10:31:17.024199 run iperf3-srv_10.42.42.10(pid=9138): Terminating (SIGTERM) 10:31:17.067138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9141): Terminating (SIGTERM) 10:31:17.109127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9144): Terminating (SIGTERM) 10:31:17.151112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9147): Terminating (SIGTERM) 10:31:17.193065 --- ParallelTerminationStrategy: PID 9131 died... 10:31:17.213580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9131): Terminated: ok {rc=0} 10:31:17.261088 --- ParallelTerminationStrategy: PID 9132 died... 10:31:17.280608 run iperf3-srv_10.42.42.10(pid=9132): Terminated {rc=256} 10:31:17.325873 --- ParallelTerminationStrategy: PID 9133 died... 10:31:17.345652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9133): Terminated: ok {rc=0} 10:31:17.391198 --- ParallelTerminationStrategy: PID 9134 died... 10:31:17.410930 run iperf3-srv_10.42.42.10(pid=9134): Terminated {rc=256} 10:31:17.456175 --- ParallelTerminationStrategy: PID 9135 died... 10:31:17.475942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9135): Terminated: ok {rc=0} 10:31:17.521368 --- ParallelTerminationStrategy: PID 9136 died... 10:31:17.541118 run iperf3-srv_10.42.42.10(pid=9136): Terminated {rc=256} 10:31:17.586410 --- ParallelTerminationStrategy: PID 9137 died... 10:31:17.606217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9137): Terminated: ok {rc=0} 10:31:17.651684 --- ParallelTerminationStrategy: PID 9138 died... 10:31:17.671518 run iperf3-srv_10.42.42.10(pid=9138): Terminated {rc=256} 10:31:17.716682 --- ParallelTerminationStrategy: PID 9141 died... 10:31:17.736453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9141): Terminated: ok {rc=0} 10:31:17.781930 --- ParallelTerminationStrategy: PID 9144 died... 10:31:17.801814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9144): Terminated: ok {rc=0} 10:31:17.847057 --- ParallelTerminationStrategy: PID 9147 died... 10:31:17.866746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9147): Terminated: ok {rc=0} 10:31:17.955179 bus /gobi_4: Setting Powered False 10:31:19.056636 bus /gobi_4: Setting Powered False 10:31:20.174573 bus /gobi_1: Setting Powered False 10:31:21.276675 bus /gobi_1: Setting Powered False 10:31:22.390562 bus /gobi_0: Setting Powered False 10:31:23.489829 bus /gobi_0: Setting Powered False 10:31:24.609869 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:31:25.716075 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:25.728433 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:31:25.802267 tst ping.py: using LAC 33329 10:31:25.932473 tst ping.py: using RAC 179 10:31:26.063428 tst ping.py: using CellId 33329 10:31:26.191079 tst ping.py: using BVCI 33330 10:31:26.311655 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.323302 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.334637 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.346147 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.357663 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.369227 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.380824 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.392387 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:31:26.510286 tst ping.py:19: start network... 10:31:26.716242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:27.191997 run create_hlr_db(pid=9149): Launched 10:31:27.319130 bus /gobi_6: Setting Powered False 10:31:28.380015 run create_hlr_db(pid=9149): Terminated: ok {rc=0} 10:31:28.832562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9151): Launched 10:31:29.165076 run osmo-hlr_10.42.42.2(pid=9152): Launched 10:31:29.289984 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:29.864904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9154): Launched 10:31:30.196550 run osmo-stp_10.42.42.5(pid=9155): Launched 10:31:30.323398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:30.919814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9157): Launched 10:31:31.064086 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:31.406961 run patchelf(pid=9158): Launched 10:31:31.657259 run osmo-stp_10.42.42.5(pid=9155): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9155)] 10:31:31.798607 run osmo-stp_10.42.42.5(pid=9155): stdout: | (launched: 2022-12-13_10:31:30.134455) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:31.933397 run osmo-stp_10.42.42.5(pid=9155): stderr: | 20221213103130325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103130325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103130325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103130326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103130326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103130326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103130326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:32.068447 run osmo-stp_10.42.42.5(pid=9155): stdout: | (launched: 2022-12-13_10:31:30.134455) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:32.198782 run osmo-stp_10.42.42.5(pid=9155): stderr: | 20221213103130325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103130325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103130325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103130326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103130326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103130326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103130326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:32.349668 run patchelf(pid=9158): Terminating (SIGINT) 10:31:32.522254 run patchelf(pid=9158): Terminated: ok {rc=0} 10:31:32.646460 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9155): Process ended prematurely: osmo-stp_10.42.42.5(pid=9155) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9155)] [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 10:31:32.657300 tst ping.py:22: Test FAILED (6.9 sec) 10:31:32.685753 run osmo-hlr_10.42.42.2(pid=9152): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9152)] 10:31:32.737342 run osmo-hlr_10.42.42.2(pid=9152): stdout: | (launched: 2022-12-13_10:31:29.103051) 10:31:32.790408 run osmo-hlr_10.42.42.2(pid=9152): stderr: | 20221213103129301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103129301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103129301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103129301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103129301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103129301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103129313 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103129322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103129323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103129323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:32.843473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9151): Terminating (SIGTERM) 10:31:32.885665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9154): Terminating (SIGTERM) 10:31:32.928425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9157): Terminating (SIGTERM) 10:31:32.971052 --- ParallelTerminationStrategy: PID 9151 died... 10:31:32.991985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9151): Terminated: ok {rc=0} 10:31:33.039239 --- ParallelTerminationStrategy: PID 9154 died... 10:31:33.059447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9154): Terminated: ok {rc=0} 10:31:33.106125 --- ParallelTerminationStrategy: PID 9157 died... 10:31:33.126333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9157): Terminated: ok {rc=0} 10:31:33.215447 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:31:34.303479 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:34.319055 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:31:34.393219 tst ping_idle_ping.py: using LAC 33330 10:31:34.524311 tst ping_idle_ping.py: using RAC 180 10:31:34.655038 tst ping_idle_ping.py: using CellId 33330 10:31:34.784533 tst ping_idle_ping.py: using BVCI 33331 10:31:34.904049 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:34.915466 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:34.926799 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:34.938078 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:34.949691 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:34.961453 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:34.973074 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:34.984814 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:31:35.102369 tst ping_idle_ping.py:24: start network... 10:31:35.308695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:35.790740 run create_hlr_db(pid=9159): Launched 10:31:35.918917 bus /gobi_6: Setting Powered False 10:31:36.980179 run create_hlr_db(pid=9159): Terminated: ok {rc=0} 10:31:37.432511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9161): Launched 10:31:37.765158 run osmo-hlr_10.42.42.2(pid=9162): Launched 10:31:37.891899 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:38.465423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9164): Launched 10:31:38.798904 run osmo-stp_10.42.42.5(pid=9165): Launched 10:31:38.926843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:39.497538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9167): Launched 10:31:39.624486 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:39.905614 run patchelf(pid=9168): Launched 10:31:40.084110 run osmo-stp_10.42.42.5(pid=9165): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9165)] 10:31:40.214911 run osmo-stp_10.42.42.5(pid=9165): stdout: | (launched: 2022-12-13_10:31:38.736221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:40.346921 run osmo-stp_10.42.42.5(pid=9165): stderr: | 20221213103138927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103138927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103138927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103138927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103138928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103138928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103138928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:40.478806 run osmo-stp_10.42.42.5(pid=9165): stdout: | (launched: 2022-12-13_10:31:38.736221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:40.605871 run osmo-stp_10.42.42.5(pid=9165): stderr: | 20221213103138927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103138927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103138927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103138927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103138928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103138928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103138928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:40.756574 run patchelf(pid=9168): Terminating (SIGINT) 10:31:40.930054 run patchelf(pid=9168): Terminated: ok {rc=0} 10:31:41.054612 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9165): Process ended prematurely: osmo-stp_10.42.42.5(pid=9165) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9165)] [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:31:41.063599 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:31:41.090561 run osmo-hlr_10.42.42.2(pid=9162): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9162)] 10:31:41.139623 run osmo-hlr_10.42.42.2(pid=9162): stdout: | (launched: 2022-12-13_10:31:37.702949) 10:31:41.189895 run osmo-hlr_10.42.42.2(pid=9162): stderr: | 20221213103137900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103137901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103137901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103137901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103137901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103137901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103137913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103137922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103137922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103137922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:41.240296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9161): Terminating (SIGTERM) 10:31:41.280733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9164): Terminating (SIGTERM) 10:31:41.321861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9167): Terminating (SIGTERM) 10:31:41.363184 --- ParallelTerminationStrategy: PID 9161 died... 10:31:41.382778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9161): Terminated: ok {rc=0} 10:31:41.427524 --- ParallelTerminationStrategy: PID 9164 died... 10:31:41.446419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9164): Terminated: ok {rc=0} 10:31:41.490546 --- ParallelTerminationStrategy: PID 9167 died... 10:31:41.509537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9167): Terminated: ok {rc=0} 10:31:41.596182 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:31:42.907994 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:31:42.915727 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:31:42.952061 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 10:31:42.992542 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 10:31:43.083444 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:31:43.117427 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 10:31:43.157544 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 10:31:43.756298 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 10:31:43.812160 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:43.824166 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:31:43.879844 tst cs_paging_gprs_active.py: using LAC 33331 10:31:44.012315 tst cs_paging_gprs_active.py: using RAC 181 10:31:44.144023 tst cs_paging_gprs_active.py: using CellId 33331 10:31:44.274958 tst cs_paging_gprs_active.py: using BVCI 33332 10:31:44.399735 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:44.411637 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:44.423456 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:44.435061 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:44.447652 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:44.460203 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:44.472878 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:44.485453 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:44.498303 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:31:44.619690 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:31:44.739979 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:31:44.953043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:45.270615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9172): Launched 10:31:45.546174 run iperf3-srv_10.42.42.10(pid=9173): Launched 10:31:45.665669 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:31:45.892632 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:46.215942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9174): Launched 10:31:46.509648 run iperf3-srv_10.42.42.10(pid=9175): Launched 10:31:46.649626 tst cs_paging_gprs_active.py:38: start network... 10:31:46.888511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:47.422862 run create_hlr_db(pid=9176): Launched 10:31:47.551360 bus /gobi_6: Setting Powered False 10:31:48.616735 run create_hlr_db(pid=9176): Terminated: ok {rc=0} 10:31:49.084783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9178): Launched 10:31:49.422298 run osmo-hlr_10.42.42.2(pid=9179): Launched 10:31:49.551253 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:50.132612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9181): Launched 10:31:50.469587 run osmo-stp_10.42.42.5(pid=9182): Launched 10:31:50.598100 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:51.179560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9184): Launched 10:31:51.307745 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:51.594574 run patchelf(pid=9185): Launched 10:31:51.783439 run osmo-stp_10.42.42.5(pid=9182): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9182)] 10:31:51.925989 run osmo-stp_10.42.42.5(pid=9182): stdout: | (launched: 2022-12-13_10:31:50.406451) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:52.068863 run osmo-stp_10.42.42.5(pid=9182): stderr: | 20221213103150598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103150598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103150598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103150599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103150599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103150599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103150599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:52.211619 run osmo-stp_10.42.42.5(pid=9182): stdout: | (launched: 2022-12-13_10:31:50.406451) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:52.348724 run osmo-stp_10.42.42.5(pid=9182): stderr: | 20221213103150598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103150598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103150598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103150599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103150599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103150599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103150599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:52.511472 run patchelf(pid=9185): Terminating (SIGINT) 10:31:52.699614 run patchelf(pid=9185): Terminated: ok {rc=0} 10:31:52.835560 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9182): Process ended prematurely: osmo-stp_10.42.42.5(pid=9182) [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9182)] [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 10:31:52.846140 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 10:31:52.874970 run osmo-hlr_10.42.42.2(pid=9179): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9179)] 10:31:52.926054 run osmo-hlr_10.42.42.2(pid=9179): stdout: | (launched: 2022-12-13_10:31:49.359038) 10:31:52.978293 run osmo-hlr_10.42.42.2(pid=9179): stderr: | 20221213103149557 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103149557 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103149557 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103149557 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103149557 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103149557 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103149569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103149578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103149579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103149579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:53.031459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9172): Terminating (SIGTERM) 10:31:53.073887 run iperf3-srv_10.42.42.10(pid=9173): Terminating (SIGTERM) 10:31:53.116570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9174): Terminating (SIGTERM) 10:31:53.159009 run iperf3-srv_10.42.42.10(pid=9175): Terminating (SIGTERM) 10:31:53.201852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9178): Terminating (SIGTERM) 10:31:53.244527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9181): Terminating (SIGTERM) 10:31:53.287406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9184): Terminating (SIGTERM) 10:31:53.330384 --- ParallelTerminationStrategy: PID 9172 died... 10:31:53.351054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9172): Terminated: ok {rc=0} 10:31:53.398097 --- ParallelTerminationStrategy: PID 9173 died... 10:31:53.418294 run iperf3-srv_10.42.42.10(pid=9173): Terminated {rc=256} 10:31:53.464759 --- ParallelTerminationStrategy: PID 9174 died... 10:31:53.485039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9174): Terminated: ok {rc=0} 10:31:53.531582 --- ParallelTerminationStrategy: PID 9175 died... 10:31:53.551813 run iperf3-srv_10.42.42.10(pid=9175): Terminated {rc=256} 10:31:53.598655 --- ParallelTerminationStrategy: PID 9178 died... 10:31:53.618820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9178): Terminated: ok {rc=0} 10:31:53.666081 --- ParallelTerminationStrategy: PID 9181 died... 10:31:53.686535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9181): Terminated: ok {rc=0} 10:31:53.733615 --- ParallelTerminationStrategy: PID 9184 died... 10:31:53.754032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9184): Terminated: ok {rc=0} 10:31:53.844267 bus /gobi_0: Setting Powered False 10:31:54.947669 bus /gobi_0: Setting Powered False 10:31:56.067083 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 10:31:57.211810 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:57.224101 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:31:57.279798 tst iperf3.py: using LAC 33332 10:31:57.404608 tst iperf3.py: using RAC 182 10:31:57.528740 tst iperf3.py: using CellId 33332 10:31:57.653513 tst iperf3.py: using BVCI 33333 10:31:57.776936 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:57.789233 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:57.801229 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:57.813116 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:57.825224 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:57.837278 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:57.849488 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:57.861675 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:57.873750 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:31:57.992247 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:31:58.204026 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:58.521272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9186): Launched 10:31:58.799342 run iperf3-srv_10.42.42.10(pid=9187): Launched 10:31:58.919700 tst iperf3.py:8: start network... 10:31:59.129921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:59.616715 run create_hlr_db(pid=9188): Launched 10:31:59.746590 bus /gobi_6: Setting Powered False 10:32:00.808625 run create_hlr_db(pid=9188): Terminated: ok {rc=0} 10:32:01.311440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9190): Launched 10:32:01.674070 run osmo-hlr_10.42.42.2(pid=9191): Launched 10:32:01.927122 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:02.624805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9193): Launched 10:32:02.942050 run osmo-stp_10.42.42.5(pid=9194): Launched 10:32:03.060479 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:03.600097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9196): Launched 10:32:03.720646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:03.986811 run patchelf(pid=9197): Launched 10:32:04.162268 run osmo-stp_10.42.42.5(pid=9194): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9194)] 10:32:04.294486 run osmo-stp_10.42.42.5(pid=9194): stdout: | (launched: 2022-12-13_10:32:02.881434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:04.428285 run osmo-stp_10.42.42.5(pid=9194): stderr: | 20221213103203054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103203054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103203055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103203055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103203056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103203056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103203056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:04.562358 run osmo-stp_10.42.42.5(pid=9194): stdout: | (launched: 2022-12-13_10:32:02.881434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:04.690560 run osmo-stp_10.42.42.5(pid=9194): stderr: | 20221213103203054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103203054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103203055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103203055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103203056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103203056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103203056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:04.842203 run patchelf(pid=9197): Terminating (SIGINT) 10:32:05.018823 run patchelf(pid=9197): Terminated: ok {rc=0} 10:32:05.146123 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9194): Process ended prematurely: osmo-stp_10.42.42.5(pid=9194) [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9194)] [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 10:32:05.155596 tst iperf3.py:8: Test FAILED (8.0 sec) 10:32:05.182983 run osmo-hlr_10.42.42.2(pid=9191): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9191)] 10:32:05.231010 run osmo-hlr_10.42.42.2(pid=9191): stdout: | (launched: 2022-12-13_10:32:01.606317) 10:32:05.281679 run osmo-hlr_10.42.42.2(pid=9191): stderr: | 20221213103201867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103201867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103201867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103201867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103201867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103201868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103201898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103201925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103201925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103201925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:05.332153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9186): Terminating (SIGTERM) 10:32:05.372567 run iperf3-srv_10.42.42.10(pid=9187): Terminating (SIGTERM) 10:32:05.412846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9190): Terminating (SIGTERM) 10:32:05.453313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9193): Terminating (SIGTERM) 10:32:05.493744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9196): Terminating (SIGTERM) 10:32:05.534391 --- ParallelTerminationStrategy: PID 9186 died... 10:32:05.553982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9186): Terminated: ok {rc=0} 10:32:05.598587 --- ParallelTerminationStrategy: PID 9187 died... 10:32:05.617484 run iperf3-srv_10.42.42.10(pid=9187): Terminated {rc=256} 10:32:05.661726 --- ParallelTerminationStrategy: PID 9190 died... 10:32:05.681011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9190): Terminated: ok {rc=0} 10:32:05.725238 --- ParallelTerminationStrategy: PID 9193 died... 10:32:05.743981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9193): Terminated: ok {rc=0} 10:32:05.788375 --- ParallelTerminationStrategy: PID 9196 died... 10:32:05.807440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9196): Terminated: ok {rc=0} 10:32:05.893999 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 10:32:07.044313 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:07.056363 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:32:07.109209 tst iperf3m4.py: using LAC 33333 10:32:07.233329 tst iperf3m4.py: using RAC 183 10:32:07.358274 tst iperf3m4.py: using CellId 33333 10:32:07.483320 tst iperf3m4.py: using BVCI 33334 10:32:07.599503 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:07.610914 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:07.622106 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:07.633315 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:07.645153 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:07.656779 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:07.668723 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:07.680511 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:07.692459 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:32:07.817494 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:32:07.943850 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:32:08.064270 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:32:08.188687 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:32:08.417580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:08.758778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9198): Launched 10:32:09.054709 run iperf3-srv_10.42.42.10(pid=9199): Launched 10:32:09.182351 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:32:09.409684 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:09.749453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9200): Launched 10:32:10.044081 run iperf3-srv_10.42.42.10(pid=9201): Launched 10:32:10.169990 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:32:10.396824 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:10.736157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9202): Launched 10:32:11.031749 run iperf3-srv_10.42.42.10(pid=9203): Launched 10:32:11.159116 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:32:11.386307 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:11.725939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9204): Launched 10:32:12.019953 run iperf3-srv_10.42.42.10(pid=9205): Launched 10:32:12.145783 tst iperf3m4.py:8: start network... 10:32:12.372215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:12.893966 run create_hlr_db(pid=9206): Launched 10:32:13.022322 bus /gobi_6: Setting Powered False 10:32:14.087802 run create_hlr_db(pid=9206): Terminated: ok {rc=0} 10:32:14.553944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9208): Launched 10:32:14.892797 run osmo-hlr_10.42.42.2(pid=9209): Launched 10:32:15.022456 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:15.604275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9211): Launched 10:32:15.949550 run osmo-stp_10.42.42.5(pid=9212): Launched 10:32:16.146938 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:16.832258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9214): Launched 10:32:16.973239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:17.263827 run patchelf(pid=9215): Launched 10:32:17.463414 run osmo-stp_10.42.42.5(pid=9212): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9212)] 10:32:17.605456 run osmo-stp_10.42.42.5(pid=9212): stdout: | (launched: 2022-12-13_10:32:15.884491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:17.749908 run osmo-stp_10.42.42.5(pid=9212): stderr: | 20221213103216226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103216226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103216227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103216227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103216228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103216228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103216228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:17.893617 run osmo-stp_10.42.42.5(pid=9212): stdout: | (launched: 2022-12-13_10:32:15.884491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:18.031276 run osmo-stp_10.42.42.5(pid=9212): stderr: | 20221213103216226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103216226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103216227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103216227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103216228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103216228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103216228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:18.194944 run patchelf(pid=9215): Terminating (SIGINT) 10:32:18.383687 run patchelf(pid=9215): Terminated: ok {rc=0} 10:32:18.520293 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9212): Process ended prematurely: osmo-stp_10.42.42.5(pid=9212) [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9212)] [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 10:32:18.531044 tst iperf3m4.py:8: Test FAILED (11.5 sec) 10:32:18.560474 run osmo-hlr_10.42.42.2(pid=9209): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9209)] 10:32:18.612391 run osmo-hlr_10.42.42.2(pid=9209): stdout: | (launched: 2022-12-13_10:32:14.829389) 10:32:18.666368 run osmo-hlr_10.42.42.2(pid=9209): stderr: | 20221213103215026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103215026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103215026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103215026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103215026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103215026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103215038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103215049 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103215050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103215050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:18.720202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9198): Terminating (SIGTERM) 10:32:18.762816 run iperf3-srv_10.42.42.10(pid=9199): Terminating (SIGTERM) 10:32:18.806128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9200): Terminating (SIGTERM) 10:32:18.848936 run iperf3-srv_10.42.42.10(pid=9201): Terminating (SIGTERM) 10:32:18.892036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9202): Terminating (SIGTERM) 10:32:18.935050 run iperf3-srv_10.42.42.10(pid=9203): Terminating (SIGTERM) 10:32:18.977784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9204): Terminating (SIGTERM) 10:32:19.020580 run iperf3-srv_10.42.42.10(pid=9205): Terminating (SIGTERM) 10:32:19.063429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9208): Terminating (SIGTERM) 10:32:19.106411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9211): Terminating (SIGTERM) 10:32:19.149432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9214): Terminating (SIGTERM) 10:32:19.192479 --- ParallelTerminationStrategy: PID 9198 died... 10:32:19.213451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9198): Terminated: ok {rc=0} 10:32:19.260663 --- ParallelTerminationStrategy: PID 9199 died... 10:32:19.281022 run iperf3-srv_10.42.42.10(pid=9199): Terminated {rc=256} 10:32:19.328160 --- ParallelTerminationStrategy: PID 9200 died... 10:32:19.348411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9200): Terminated: ok {rc=0} 10:32:19.395629 --- ParallelTerminationStrategy: PID 9201 died... 10:32:19.416006 run iperf3-srv_10.42.42.10(pid=9201): Terminated {rc=256} 10:32:19.463095 --- ParallelTerminationStrategy: PID 9202 died... 10:32:19.483569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9202): Terminated: ok {rc=0} 10:32:19.530840 --- ParallelTerminationStrategy: PID 9203 died... 10:32:19.550983 run iperf3-srv_10.42.42.10(pid=9203): Terminated {rc=256} 10:32:19.598109 --- ParallelTerminationStrategy: PID 9204 died... 10:32:19.618471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9204): Terminated: ok {rc=0} 10:32:19.665998 --- ParallelTerminationStrategy: PID 9205 died... 10:32:19.686272 run iperf3-srv_10.42.42.10(pid=9205): Terminated {rc=256} 10:32:19.733612 --- ParallelTerminationStrategy: PID 9208 died... 10:32:19.754102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9208): Terminated: ok {rc=0} 10:32:19.801422 --- ParallelTerminationStrategy: PID 9211 died... 10:32:19.821815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9211): Terminated: ok {rc=0} 10:32:19.868828 --- ParallelTerminationStrategy: PID 9214 died... 10:32:19.889605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9214): Terminated: ok {rc=0} 10:32:19.979197 bus /gobi_4: Setting Powered False 10:32:21.079672 bus /gobi_4: Setting Powered False 10:32:22.197030 bus /gobi_1: Setting Powered False 10:32:23.296417 bus /gobi_1: Setting Powered False 10:32:24.413431 bus /gobi_0: Setting Powered False 10:32:25.512424 bus /gobi_0: Setting Powered False 10:32:26.629403 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 10:32:27.733211 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:27.745871 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:32:27.801367 tst ping.py: using LAC 33334 10:32:27.931441 tst ping.py: using RAC 184 10:32:28.061392 tst ping.py: using CellId 33334 10:32:28.191463 tst ping.py: using BVCI 33335 10:32:28.310920 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:28.322867 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:28.334697 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:28.346424 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:28.358266 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:28.370220 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:28.382440 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:28.394378 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:32:28.513540 tst ping.py:19: start network... 10:32:28.720198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:29.198410 run create_hlr_db(pid=9216): Launched 10:32:29.326338 bus /gobi_6: Setting Powered False 10:32:30.391197 run create_hlr_db(pid=9216): Terminated: ok {rc=0} 10:32:30.853328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9218): Launched 10:32:31.241683 run osmo-hlr_10.42.42.2(pid=9219): Launched 10:32:31.484513 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:32.069624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9221): Launched 10:32:32.411551 run osmo-stp_10.42.42.5(pid=9222): Launched 10:32:32.540126 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:33.112849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9224): Launched 10:32:33.239169 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:33.520670 run patchelf(pid=9225): Launched 10:32:33.704647 run osmo-stp_10.42.42.5(pid=9222): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9222)] 10:32:33.844100 run osmo-stp_10.42.42.5(pid=9222): stdout: | (launched: 2022-12-13_10:32:32.349352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:33.984624 run osmo-stp_10.42.42.5(pid=9222): stderr: | 20221213103232539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103232539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103232539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103232540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103232540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103232540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103232540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:34.125209 run osmo-stp_10.42.42.5(pid=9222): stdout: | (launched: 2022-12-13_10:32:32.349352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:34.260264 run osmo-stp_10.42.42.5(pid=9222): stderr: | 20221213103232539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103232539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103232539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103232540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103232540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103232540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103232540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:34.420282 run patchelf(pid=9225): Terminating (SIGINT) 10:32:34.605065 run patchelf(pid=9225): Terminated: ok {rc=0} 10:32:34.739427 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9222): Process ended prematurely: osmo-stp_10.42.42.5(pid=9222) [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9222)] [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 10:32:34.749349 tst ping.py:22: Test FAILED (7.0 sec) 10:32:34.777894 run osmo-hlr_10.42.42.2(pid=9219): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9219)] 10:32:34.829575 run osmo-hlr_10.42.42.2(pid=9219): stdout: | (launched: 2022-12-13_10:32:31.171262) 10:32:34.882958 run osmo-hlr_10.42.42.2(pid=9219): stderr: | 20221213103231397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103231397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103231397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103231397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103231397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103231397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103231411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103231427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103231428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103231428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:34.936409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9218): Terminating (SIGTERM) 10:32:34.979073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9221): Terminating (SIGTERM) 10:32:35.022437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9224): Terminating (SIGTERM) 10:32:35.065386 --- ParallelTerminationStrategy: PID 9218 died... 10:32:35.086146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9218): Terminated: ok {rc=0} 10:32:35.133553 --- ParallelTerminationStrategy: PID 9221 died... 10:32:35.153823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9221): Terminated: ok {rc=0} 10:32:35.201319 --- ParallelTerminationStrategy: PID 9224 died... 10:32:35.221637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9224): Terminated: ok {rc=0} 10:32:35.312003 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 10:32:36.401306 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:36.415830 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:32:36.470427 tst ping_idle_ping.py: using LAC 33335 10:32:36.598740 tst ping_idle_ping.py: using RAC 185 10:32:36.730250 tst ping_idle_ping.py: using CellId 33335 10:32:36.860919 tst ping_idle_ping.py: using BVCI 33336 10:32:36.973779 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:36.985387 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:36.996523 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:37.007833 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:37.019087 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:37.030291 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:37.041580 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:37.052763 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:32:37.170970 tst ping_idle_ping.py:24: start network... 10:32:37.377736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:37.859075 run create_hlr_db(pid=9226): Launched 10:32:37.985974 bus /gobi_6: Setting Powered False 10:32:39.047253 run create_hlr_db(pid=9226): Terminated: ok {rc=0} 10:32:39.479505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9228): Launched 10:32:39.790291 run osmo-hlr_10.42.42.2(pid=9229): Launched 10:32:39.907079 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:40.453223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9231): Launched 10:32:40.763487 run osmo-stp_10.42.42.5(pid=9232): Launched 10:32:40.881756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:41.414749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9234): Launched 10:32:41.534876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:41.797346 run patchelf(pid=9235): Launched 10:32:41.968600 run osmo-stp_10.42.42.5(pid=9232): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9232)] 10:32:42.098791 run osmo-stp_10.42.42.5(pid=9232): stdout: | (launched: 2022-12-13_10:32:40.704656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:42.230488 run osmo-stp_10.42.42.5(pid=9232): stderr: | 20221213103240878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103240878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103240879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103240879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103240879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103240880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103240880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:42.362142 run osmo-stp_10.42.42.5(pid=9232): stdout: | (launched: 2022-12-13_10:32:40.704656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:42.488087 run osmo-stp_10.42.42.5(pid=9232): stderr: | 20221213103240878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103240878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103240879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103240879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103240879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103240880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103240880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:42.637229 run patchelf(pid=9235): Terminating (SIGINT) 10:32:42.810512 run patchelf(pid=9235): Terminated: ok {rc=0} 10:32:42.935072 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9232): Process ended prematurely: osmo-stp_10.42.42.5(pid=9232) [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9232)] [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 10:32:42.944080 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:32:42.970886 run osmo-hlr_10.42.42.2(pid=9229): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9229)] 10:32:43.018886 run osmo-hlr_10.42.42.2(pid=9229): stdout: | (launched: 2022-12-13_10:32:39.731520) 10:32:43.068569 run osmo-hlr_10.42.42.2(pid=9229): stderr: | 20221213103239909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103239909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103239909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103239909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103239909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103239909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103239921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103239929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103239930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103239930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:43.118579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9228): Terminating (SIGTERM) 10:32:43.158583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9231): Terminating (SIGTERM) 10:32:43.198712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9234): Terminating (SIGTERM) 10:32:43.239502 --- ParallelTerminationStrategy: PID 9228 died... 10:32:43.259034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9228): Terminated: ok {rc=0} 10:32:43.303387 --- ParallelTerminationStrategy: PID 9231 died... 10:32:43.322442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9231): Terminated: ok {rc=0} 10:32:43.366804 --- ParallelTerminationStrategy: PID 9234 died... 10:32:43.385646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9234): Terminated: ok {rc=0} 10:32:43.471468 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:32:44.782412 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:32:44.789890 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:32:44.824080 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:32:44.860423 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:32:44.915422 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:32:44.949767 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:32:44.985704 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:32:45.539301 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:32:45.544382 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:45.555691 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:32:45.624671 tst switch_tch_pdch.py: using LAC 33336 10:32:45.744213 tst switch_tch_pdch.py: using RAC 186 10:32:45.871002 tst switch_tch_pdch.py: using CellId 33336 10:32:46.003348 tst switch_tch_pdch.py: using BVCI 33337 10:32:46.122925 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:46.134971 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:46.147172 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:46.159541 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:46.172600 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:46.184657 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:46.196751 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:46.208917 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:32:46.332754 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:32:46.476805 tst switch_tch_pdch.py:51: start network... 10:32:46.732228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:47.258921 run create_hlr_db(pid=9240): Launched 10:32:47.385243 bus /gobi_6: Setting Powered False 10:32:48.446368 run create_hlr_db(pid=9240): Terminated: ok {rc=0} 10:32:48.900298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9242): Launched 10:32:49.233821 run osmo-hlr_10.42.42.2(pid=9243): Launched 10:32:49.361554 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:49.936202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9245): Launched 10:32:50.269295 run osmo-stp_10.42.42.5(pid=9246): Launched 10:32:50.397363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:50.967916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9248): Launched 10:32:51.094011 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:51.375126 run patchelf(pid=9249): Launched 10:32:51.557655 run osmo-stp_10.42.42.5(pid=9246): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9246)] 10:32:51.697854 run osmo-stp_10.42.42.5(pid=9246): stdout: | (launched: 2022-12-13_10:32:50.206900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:51.839485 run osmo-stp_10.42.42.5(pid=9246): stderr: | 20221213103250396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103250396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103250396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103250397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103250397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103250397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103250397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:51.980860 run osmo-stp_10.42.42.5(pid=9246): stdout: | (launched: 2022-12-13_10:32:50.206900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:52.116198 run osmo-stp_10.42.42.5(pid=9246): stderr: | 20221213103250396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103250396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103250396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103250397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103250397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103250397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103250397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:52.276923 run patchelf(pid=9249): Terminating (SIGINT) 10:32:52.462097 run patchelf(pid=9249): Terminated: ok {rc=0} 10:32:52.595495 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9246): Process ended prematurely: osmo-stp_10.42.42.5(pid=9246) [trial-2388↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9246)] [trial-2388↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:32:52.605312 tst switch_tch_pdch.py:54: Test FAILED (7.1 sec) 10:32:52.633613 run osmo-hlr_10.42.42.2(pid=9243): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9243)] 10:32:52.686085 run osmo-hlr_10.42.42.2(pid=9243): stdout: | (launched: 2022-12-13_10:32:49.171554) 10:32:52.738991 run osmo-hlr_10.42.42.2(pid=9243): stderr: | 20221213103249369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103249369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103249369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103249369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103249369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103249369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103249381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103249390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103249390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103249390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:52.792179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9242): Terminating (SIGTERM) 10:32:52.834979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9245): Terminating (SIGTERM) 10:32:52.877973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9248): Terminating (SIGTERM) 10:32:52.921752 --- ParallelTerminationStrategy: PID 9242 died... 10:32:52.942154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9242): Terminated: ok {rc=0} 10:32:52.989350 --- ParallelTerminationStrategy: PID 9245 died... 10:32:53.009545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9245): Terminated: ok {rc=0} 10:32:53.056668 --- ParallelTerminationStrategy: PID 9248 died... 10:32:53.076914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9248): Terminated: ok {rc=0} 10:32:53.166212 bus /gobi_0: Setting Powered False 10:32:54.266646 bus /gobi_0: Setting Powered False 10:32:55.384261 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:32:56.634500 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:32:56.640304 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:32:56.673204 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:32:56.707877 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:32:56.760299 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:32:56.793732 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:32:56.828106 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:32:57.385752 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:32:57.391103 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:57.402587 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:32:57.473978 tst switch_tch_pdch.py: using LAC 33337 10:32:57.604806 tst switch_tch_pdch.py: using RAC 187 10:32:57.733178 tst switch_tch_pdch.py: using CellId 33337 10:32:57.861378 tst switch_tch_pdch.py: using BVCI 33338 10:32:57.981583 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:57.993206 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:58.004450 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:58.015808 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:58.027397 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:58.039029 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:58.050764 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:58.062423 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:32:58.179902 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:32:58.303658 tst switch_tch_pdch.py:51: start network... 10:32:58.526883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:59.012163 run create_hlr_db(pid=9257): Launched 10:32:59.139601 bus /gobi_6: Setting Powered False 10:33:00.200402 run create_hlr_db(pid=9257): Terminated: ok {rc=0} 10:33:00.605671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9259): Launched 10:33:00.946616 run osmo-hlr_10.42.42.2(pid=9260): Launched 10:33:01.205284 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:01.809151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9263): Launched 10:33:02.140251 run osmo-stp_10.42.42.5(pid=9264): Launched 10:33:02.383763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:33:02.886384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9266): Launched 10:33:03.003133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:33:03.264121 run patchelf(pid=9267): Launched 10:33:03.435115 run osmo-stp_10.42.42.5(pid=9264): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9264)] 10:33:03.565485 run osmo-stp_10.42.42.5(pid=9264): stdout: | (launched: 2022-12-13_10:33:02.078634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:03.696779 run osmo-stp_10.42.42.5(pid=9264): stderr: | 20221213103302258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103302258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103302259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103302259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103302259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103302260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103302260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:03.827870 run osmo-stp_10.42.42.5(pid=9264): stdout: | (launched: 2022-12-13_10:33:02.078634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:03.953394 run osmo-stp_10.42.42.5(pid=9264): stderr: | 20221213103302258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103302258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103302259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103302259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103302259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103302260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103302260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:04.102237 run patchelf(pid=9267): Terminating (SIGINT) 10:33:04.274568 run patchelf(pid=9267): Terminated: ok {rc=0} 10:33:04.398415 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9264): Process ended prematurely: osmo-stp_10.42.42.5(pid=9264) [trial-2388↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9264)] [trial-2388↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:33:04.407373 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 10:33:04.434286 run osmo-hlr_10.42.42.2(pid=9260): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9260)] 10:33:04.482789 run osmo-hlr_10.42.42.2(pid=9260): stdout: | (launched: 2022-12-13_10:33:00.864788) 10:33:04.533112 run osmo-hlr_10.42.42.2(pid=9260): stderr: | 20221213103301165 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103301166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103301166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103301166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103301166 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103301166 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103301189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103301197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103301198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103301198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:04.583600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9259): Terminating (SIGTERM) 10:33:04.624107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9263): Terminating (SIGTERM) 10:33:04.664643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9266): Terminating (SIGTERM) 10:33:04.705883 --- ParallelTerminationStrategy: PID 9259 died... 10:33:04.725183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9259): Terminated: ok {rc=0} 10:33:04.770075 --- ParallelTerminationStrategy: PID 9263 died... 10:33:04.789117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9263): Terminated: ok {rc=0} 10:33:04.833613 --- ParallelTerminationStrategy: PID 9266 died... 10:33:04.852534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9266): Terminated: ok {rc=0} 10:33:04.939809 bus /gobi_0: Setting Powered False 10:33:06.041041 bus /gobi_0: Setting Powered False 10:33:07.156592 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 10:33:08.413524 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:33:08.417814 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:33:08.452306 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 10:33:08.460009 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 10:33:08.512986 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:33:08.547371 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 10:33:08.554452 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 10:33:09.094241 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 10:33:09.099746 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 10:33:09.111081 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:33:09.164046 tst mo_mt_sms.py: using LAC 33338 10:33:09.285694 tst mo_mt_sms.py: using RAC 188 10:33:09.404134 tst mo_mt_sms.py: using CellId 33338 10:33:09.525610 tst mo_mt_sms.py: using BVCI 33339 10:33:09.637894 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:33:09.760084 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:33:09.879754 tst mo_mt_sms.py:9: start nitb and bts... 10:33:10.085502 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:33:10.711058 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9271): Launched 10:33:11.019118 run osmo-nitb_10.42.42.2(pid=9272): Launched 10:33:11.190714 run osmo-nitb_10.42.42.2(pid=9272): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9272)] 10:33:11.327556 run osmo-nitb_10.42.42.2(pid=9272): stdout: | (launched: 2022-12-13_10:33:10.960314) 10:33:11.466647 run osmo-nitb_10.42.42.2(pid=9272): stderr: | (launched: 2022-12-13_10:33:11.005864) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:33:11.605126 run osmo-nitb_10.42.42.2(pid=9272): stdout: | (launched: 2022-12-13_10:33:10.960314) 10:33:11.738163 run osmo-nitb_10.42.42.2(pid=9272): stderr: | (launched: 2022-12-13_10:33:11.005864) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9272): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9272) [trial-2388↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9272)] 10:33:12.136917 tst osmo-nitb_10.42.42.2(pid=9272): stdout: | (launched: 2022-12-13_10:33:10.960314) 10:33:12.261972 tst osmo-nitb_10.42.42.2(pid=9272): stderr: | (launched: 2022-12-13_10:33:11.005864) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:33:12.408135 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9272): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9272) [trial-2388↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9272)] [trial-2388↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 10:33:12.417075 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 10:33:12.423802 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9271): Terminating (SIGTERM) 10:33:12.633439 --- ParallelTerminationStrategy: PID 9271 died... 10:33:12.654105 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9271): Terminated: ok {rc=0} 10:33:12.740682 bus /sierra_3: Setting Powered False 10:33:13.839713 bus /sierra_3: Setting Powered False 10:33:14.958814 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 sms:trx-sysmocell5000 --------------------------------------------------------------------- 10:33:16.157121 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:33:16.161586 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:33:16.197190 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 10:33:16.225346 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 10:33:16.288486 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:33:16.345795 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 10:33:16.374660 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 10:33:16.890094 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 10:33:16.895625 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:33:16.907471 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:33:16.959242 tst mo_mt_sms.py: using LAC 33339 10:33:17.093528 tst mo_mt_sms.py: using RAC 189 10:33:17.244920 tst mo_mt_sms.py: using CellId 33339 10:33:17.374030 tst mo_mt_sms.py: using BVCI 33340 10:33:17.493449 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:33:17.504866 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:33:17.516066 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:33:17.527306 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:33:17.538854 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:33:17.550439 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:33:17.670188 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:33:17.792738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:18.306712 run create_hlr_db(pid=9276): Launched 10:33:18.434464 bus /sierra_2: Setting Powered False 10:33:19.499707 run create_hlr_db(pid=9276): Terminated: ok {rc=0} 10:33:19.962130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9278): Launched 10:33:20.294692 run osmo-hlr_10.42.42.2(pid=9279): Launched 10:33:20.421764 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:20.993021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9281): Launched 10:33:21.325326 run osmo-stp_10.42.42.5(pid=9282): Launched 10:33:21.452120 run osmo-msc_10.42.42.6: Starting osmo-msc 10:33:22.048222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9284): Launched 10:33:22.379318 run osmo-msc_10.42.42.6(pid=9285): Launched 10:33:22.562820 run osmo-stp_10.42.42.5(pid=9282): ERR: Terminated: ERROR {rc=1} [trial-2388↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9282)] 10:33:22.702743 run osmo-stp_10.42.42.5(pid=9282): stdout: | (launched: 2022-12-13_10:33:21.262669) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:22.842222 run osmo-stp_10.42.42.5(pid=9282): stderr: | 20221213103321451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103321452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103321452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103321452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103321453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103321453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103321453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:22.978959 run osmo-stp_10.42.42.5(pid=9282): stdout: | (launched: 2022-12-13_10:33:21.262669) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:23.110327 run osmo-stp_10.42.42.5(pid=9282): stderr: | 20221213103321451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103321452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103321452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103321452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103321453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103321453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103321453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:23.267348 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9282): Process ended prematurely: osmo-stp_10.42.42.5(pid=9282) [trial-2388↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9282)] [trial-2388↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 10:33:23.276412 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 10:33:23.304029 run osmo-hlr_10.42.42.2(pid=9279): ERR: Terminated: ERROR {rc=237} [trial-2388↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9279)] 10:33:23.355001 run osmo-hlr_10.42.42.2(pid=9279): stdout: | (launched: 2022-12-13_10:33:20.232192) 10:33:23.407814 run osmo-hlr_10.42.42.2(pid=9279): stderr: | 20221213103320428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103320428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103320428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103320428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103320428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103320428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103320440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103320449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103320449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103320449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:23.481048 run osmo-msc_10.42.42.6(pid=9285): ERR: Terminated: ERROR {rc=2} [trial-2388↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9285)] 10:33:23.531323 run osmo-msc_10.42.42.6(pid=9285): stdout: | (launched: 2022-12-13_10:33:22.316708) 10:33:23.584198 run osmo-msc_10.42.42.6(pid=9285): stderr: | 20221213103322637 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103322638 DLGLOBAL DEBUG validating counter group 0x7fce5b605c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103322638 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103322638 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103322638 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103322638 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103322640 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103322640 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103322640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103322640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:33:23.637413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9278): Terminating (SIGTERM) 10:33:23.679435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9281): Terminating (SIGTERM) 10:33:23.722386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9284): Terminating (SIGTERM) 10:33:23.765166 --- ParallelTerminationStrategy: PID 9278 died... 10:33:23.785695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9278): Terminated: ok {rc=0} 10:33:23.832722 --- ParallelTerminationStrategy: PID 9281 died... 10:33:23.852900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9281): Terminated: ok {rc=0} 10:33:23.899812 --- ParallelTerminationStrategy: PID 9284 died... 10:33:23.919917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9284): Terminated: ok {rc=0} 10:33:24.010410 bus /sierra_3: Setting Powered False 10:33:25.111155 bus /sierra_3: Setting Powered False 10:33:26.230342 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 10:33:27.463747 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:33:27.467684 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:33:27.501295 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 10:33:27.508605 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 10:33:27.544323 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:33:27.578300 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 10:33:27.585493 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 10:33:28.104367 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2388 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 10:33:28.109459 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 10:33:28.120355 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:33:28.167508 tst assert_extension.py: using LAC 33340 10:33:28.297957 tst assert_extension.py: using RAC 190 10:33:28.428474 tst assert_extension.py: using CellId 33340 10:33:28.556640 tst assert_extension.py: using BVCI 33341 10:33:28.677920 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 10:33:28.795336 tst assert_extension.py:10: start nitb and bts... 10:33:29.000750 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:33:29.633152 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9290): Launched 10:33:29.944193 run osmo-nitb_10.42.42.2(pid=9291): Launched 10:33:30.115511 run osmo-nitb_10.42.42.2(pid=9291): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9291)] 10:33:30.252573 run osmo-nitb_10.42.42.2(pid=9291): stdout: | (launched: 2022-12-13_10:33:29.885466) 10:33:30.391070 run osmo-nitb_10.42.42.2(pid=9291): stderr: | (launched: 2022-12-13_10:33:29.931101) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:33:30.530009 run osmo-nitb_10.42.42.2(pid=9291): stdout: | (launched: 2022-12-13_10:33:29.885466) 10:33:30.663014 run osmo-nitb_10.42.42.2(pid=9291): stderr: | (launched: 2022-12-13_10:33:29.931101) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9291): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9291) [trial-2388↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9291)] 10:33:31.060766 tst osmo-nitb_10.42.42.2(pid=9291): stdout: | (launched: 2022-12-13_10:33:29.885466) 10:33:31.197123 tst osmo-nitb_10.42.42.2(pid=9291): stderr: | (launched: 2022-12-13_10:33:29.931101) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:33:31.361110 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9291): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9291) [trial-2388↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9291)] [trial-2388↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 10:33:31.371327 tst assert_extension.py:12: Test FAILED (3.3 sec) 10:33:31.379664 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9290): Terminating (SIGTERM) 10:33:31.595428 --- ParallelTerminationStrategy: PID 9290 died... 10:33:31.628631 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9290): Terminated: ok {rc=0} 10:33:31.753200 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 10:33:32.952700 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:33:32.957991 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:33:32.991884 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 10:33:33.018767 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 10:33:33.056687 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:33:33.091215 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 10:33:33.117705 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 10:33:33.647033 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2388 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 10:33:33.652380 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:33:33.663399 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:33:33.710488 tst assert_extension.py: using LAC 33341 10:33:33.829104 tst assert_extension.py: using RAC 191 10:33:33.946645 tst assert_extension.py: using CellId 33341 10:33:34.069242 tst assert_extension.py: using BVCI 33342 10:33:34.181273 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:33:34.191976 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:33:34.202622 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:33:34.213179 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:33:34.223650 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:33:34.234212 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 10:33:34.349043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:34.825404 run create_hlr_db(pid=9295): Launched 10:33:34.953375 bus /sierra_2: Setting Powered False 10:33:36.014396 run create_hlr_db(pid=9295): Terminated: ok {rc=0} 10:33:36.443984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9297): Launched 10:33:36.755256 run osmo-hlr_10.42.42.2(pid=9298): Launched 10:33:36.873274 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:37.513210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9300): Launched 10:33:37.820231 run osmo-stp_10.42.42.5(pid=9301): Launched 10:33:37.939477 run osmo-msc_10.42.42.6: Starting osmo-msc 10:33:38.491195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9303): Launched 10:33:38.797220 run osmo-msc_10.42.42.6(pid=9304): Launched 10:33:38.967017 run osmo-stp_10.42.42.5(pid=9301): ERR: Terminated: ERROR {rc=1} [trial-2388↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9301)] 10:33:39.095099 run osmo-stp_10.42.42.5(pid=9301): stdout: | (launched: 2022-12-13_10:33:37.762249) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:39.222815 run osmo-stp_10.42.42.5(pid=9301): stderr: | 20221213103337932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103337932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103337933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103337933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103337934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103337934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103337934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:39.349227 run osmo-stp_10.42.42.5(pid=9301): stdout: | (launched: 2022-12-13_10:33:37.762249) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:39.470224 run osmo-stp_10.42.42.5(pid=9301): stderr: | 20221213103337932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103337932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103337933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103337933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103337934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103337934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103337934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:39.614859 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9301): Process ended prematurely: osmo-stp_10.42.42.5(pid=9301) [trial-2388↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9301)] [trial-2388↪ussd:trx-sysmocell5000↪assert_extension.py:17] 10:33:39.623294 tst assert_extension.py:17: Test FAILED (6.0 sec) 10:33:39.649710 run osmo-hlr_10.42.42.2(pid=9298): ERR: Terminated: ERROR {rc=237} [trial-2388↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9298)] 10:33:39.699144 run osmo-hlr_10.42.42.2(pid=9298): stdout: | (launched: 2022-12-13_10:33:36.696563) 10:33:39.749519 run osmo-hlr_10.42.42.2(pid=9298): stderr: | 20221213103336872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103336872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103336872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103336872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103336872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103336872 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103336885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103336893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103336893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103336893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:39.819758 run osmo-msc_10.42.42.6(pid=9304): ERR: Terminated: ERROR {rc=2} [trial-2388↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9304)] 10:33:39.868209 run osmo-msc_10.42.42.6(pid=9304): stdout: | (launched: 2022-12-13_10:33:38.739071) 10:33:39.918538 run osmo-msc_10.42.42.6(pid=9304): stderr: | 20221213103339009 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103339009 DLGLOBAL DEBUG validating counter group 0x7f3e85185c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103339009 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103339009 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103339009 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103339010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103339011 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103339012 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103339012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103339012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:33:39.969979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9297): Terminating (SIGTERM) 10:33:40.010566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9300): Terminating (SIGTERM) 10:33:40.051021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9303): Terminating (SIGTERM) 10:33:40.091755 --- ParallelTerminationStrategy: PID 9297 died... 10:33:40.111530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9297): Terminated: ok {rc=0} 10:33:40.156228 --- ParallelTerminationStrategy: PID 9300 died... 10:33:40.175245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9300): Terminated: ok {rc=0} 10:33:40.219728 --- ParallelTerminationStrategy: PID 9303 died... 10:33:40.238465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9303): Terminated: ok {rc=0} 10:33:40.325284 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:33:41.540136 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:33:41.547359 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:33:41.581721 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:33:41.608431 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:33:41.660714 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:33:41.695152 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:33:41.722787 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:33:42.272145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:33:42.323720 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:42.335579 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:33:42.406797 tst mo_mt_call.py: using LAC 33342 10:33:42.530566 tst mo_mt_call.py: using RAC 192 10:33:42.654894 tst mo_mt_call.py: using CellId 33342 10:33:42.779844 tst mo_mt_call.py: using BVCI 33343 10:33:42.894554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:42.906030 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:42.917274 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:42.928537 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:42.940164 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:42.951921 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:33:43.076014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:33:43.195296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:43.679368 run create_hlr_db(pid=9309): Launched 10:33:43.807703 bus /sierra_2: Setting Powered False 10:33:44.869329 run create_hlr_db(pid=9309): Terminated: ok {rc=0} 10:33:45.303875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9311): Launched 10:33:45.618234 run osmo-hlr_10.42.42.2(pid=9312): Launched 10:33:45.736940 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:46.329616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9314): Launched 10:33:46.682739 run osmo-stp_10.42.42.5(pid=9315): Launched 10:33:47.013212 run osmo-msc_10.42.42.6: Starting osmo-msc 10:33:47.629163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9317): Launched 10:33:47.963515 run osmo-msc_10.42.42.6(pid=9318): Launched 10:33:48.149227 run osmo-stp_10.42.42.5(pid=9315): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9315)] 10:33:48.288444 run osmo-stp_10.42.42.5(pid=9315): stdout: | (launched: 2022-12-13_10:33:46.615290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:48.428455 run osmo-stp_10.42.42.5(pid=9315): stderr: | 20221213103346862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103346862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103346862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103346863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103346863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103346863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103346863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:48.566711 run osmo-stp_10.42.42.5(pid=9315): stdout: | (launched: 2022-12-13_10:33:46.615290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:48.699279 run osmo-stp_10.42.42.5(pid=9315): stderr: | 20221213103346862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103346862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103346862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103346863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103346863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103346863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103346863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:48.857524 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9315): Process ended prematurely: osmo-stp_10.42.42.5(pid=9315) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9315)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:33:48.867360 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:33:48.895255 run osmo-hlr_10.42.42.2(pid=9312): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9312)] 10:33:48.946283 run osmo-hlr_10.42.42.2(pid=9312): stdout: | (launched: 2022-12-13_10:33:45.559288) 10:33:48.999221 run osmo-hlr_10.42.42.2(pid=9312): stderr: | 20221213103345737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103345737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103345737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103345737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103345737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103345737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103345749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103345758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103345758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103345758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:49.072637 run osmo-msc_10.42.42.6(pid=9318): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9318)] 10:33:49.123421 run osmo-msc_10.42.42.6(pid=9318): stdout: | (launched: 2022-12-13_10:33:47.901210) 10:33:49.176611 run osmo-msc_10.42.42.6(pid=9318): stderr: | 20221213103348223 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103348223 DLGLOBAL DEBUG validating counter group 0x7fc63846ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103348223 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103348223 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103348223 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103348224 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103348225 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103348226 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103348226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103348226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:33:49.229811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9311): Terminating (SIGTERM) 10:33:49.272687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9314): Terminating (SIGTERM) 10:33:49.315479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9317): Terminating (SIGTERM) 10:33:49.358656 --- ParallelTerminationStrategy: PID 9311 died... 10:33:49.379247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9311): Terminated: ok {rc=0} 10:33:49.426409 --- ParallelTerminationStrategy: PID 9314 died... 10:33:49.446675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9314): Terminated: ok {rc=0} 10:33:49.493548 --- ParallelTerminationStrategy: PID 9317 died... 10:33:49.513718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9317): Terminated: ok {rc=0} 10:33:49.602776 bus /sierra_3: Setting Powered False 10:33:50.703075 bus /sierra_3: Setting Powered False 10:33:51.817248 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:33:52.968775 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:52.981404 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:33:53.054511 tst mo_mt_call_osmux.py: using LAC 33343 10:33:53.185931 tst mo_mt_call_osmux.py: using RAC 193 10:33:53.317982 tst mo_mt_call_osmux.py: using CellId 33343 10:33:53.452435 tst mo_mt_call_osmux.py: using BVCI 33344 10:33:53.574726 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:53.586667 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:53.598458 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:53.610151 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:53.622158 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:53.634133 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:33:53.753508 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:33:53.878039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:54.395567 run create_hlr_db(pid=9320): Launched 10:33:54.523245 bus /sierra_2: Setting Powered False 10:33:55.588475 run create_hlr_db(pid=9320): Terminated: ok {rc=0} 10:33:56.033977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9322): Launched 10:33:56.346216 run osmo-hlr_10.42.42.2(pid=9323): Launched 10:33:56.465765 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:57.000092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9325): Launched 10:33:57.313261 run osmo-stp_10.42.42.5(pid=9326): Launched 10:33:57.432124 run osmo-msc_10.42.42.6: Starting osmo-msc 10:33:57.994900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9328): Launched 10:33:58.307151 run osmo-msc_10.42.42.6(pid=9329): Launched 10:33:58.482196 run osmo-stp_10.42.42.5(pid=9326): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9326)] 10:33:58.612115 run osmo-stp_10.42.42.5(pid=9326): stdout: | (launched: 2022-12-13_10:33:57.254295) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:58.742368 run osmo-stp_10.42.42.5(pid=9326): stderr: | 20221213103357423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103357423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103357423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103357424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103357425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103357425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103357425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:58.870725 run osmo-stp_10.42.42.5(pid=9326): stdout: | (launched: 2022-12-13_10:33:57.254295) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:58.993345 run osmo-stp_10.42.42.5(pid=9326): stderr: | 20221213103357423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103357423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103357423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103357424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103357425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103357425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103357425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:59.140448 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9326): Process ended prematurely: osmo-stp_10.42.42.5(pid=9326) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9326)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:33:59.149800 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:33:59.175859 run osmo-hlr_10.42.42.2(pid=9323): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9323)] 10:33:59.223552 run osmo-hlr_10.42.42.2(pid=9323): stdout: | (launched: 2022-12-13_10:33:56.287137) 10:33:59.272791 run osmo-hlr_10.42.42.2(pid=9323): stderr: | 20221213103356463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103356463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103356463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103356463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103356463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103356463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103356477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103356487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103356487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103356487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:59.342107 run osmo-msc_10.42.42.6(pid=9329): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9329)] 10:33:59.389940 run osmo-msc_10.42.42.6(pid=9329): stdout: | (launched: 2022-12-13_10:33:58.246650) 10:33:59.439160 run osmo-msc_10.42.42.6(pid=9329): stderr: | 20221213103358520 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103358520 DLGLOBAL DEBUG validating counter group 0x7fab1eee1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103358520 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103358520 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103358520 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103358521 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103358522 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103358523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103358523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103358523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:33:59.488942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9322): Terminating (SIGTERM) 10:33:59.528729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9325): Terminating (SIGTERM) 10:33:59.568490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9328): Terminating (SIGTERM) 10:33:59.608523 --- ParallelTerminationStrategy: PID 9322 died... 10:33:59.627889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9322): Terminated: ok {rc=0} 10:33:59.672058 --- ParallelTerminationStrategy: PID 9325 died... 10:33:59.690732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9325): Terminated: ok {rc=0} 10:33:59.734787 --- ParallelTerminationStrategy: PID 9328 died... 10:33:59.753438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9328): Terminated: ok {rc=0} 10:33:59.840081 bus /sierra_3: Setting Powered False 10:34:00.955024 bus /sierra_3: Setting Powered False 10:34:02.094593 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:34:03.358290 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:34:03.364999 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:34:03.398632 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:34:03.425318 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:34:03.475983 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:34:03.510015 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:34:03.537900 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:34:04.088408 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:34:04.139082 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:04.150490 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:34:04.221142 tst mo_mt_call.py: using LAC 33344 10:34:04.352444 tst mo_mt_call.py: using RAC 194 10:34:04.483612 tst mo_mt_call.py: using CellId 33344 10:34:04.613177 tst mo_mt_call.py: using BVCI 33345 10:34:04.734595 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:04.746523 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:04.758341 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:04.770094 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:04.782064 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:04.794018 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:34:04.915308 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:34:05.038032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:05.553636 run create_hlr_db(pid=9335): Launched 10:34:05.681750 bus /sierra_2: Setting Powered False 10:34:06.746885 run create_hlr_db(pid=9335): Terminated: ok {rc=0} 10:34:07.209138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9337): Launched 10:34:07.543567 run osmo-hlr_10.42.42.2(pid=9338): Launched 10:34:07.671919 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:08.244602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9340): Launched 10:34:08.578490 run osmo-stp_10.42.42.5(pid=9341): Launched 10:34:08.705963 run osmo-msc_10.42.42.6: Starting osmo-msc 10:34:09.311872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9343): Launched 10:34:09.646563 run osmo-msc_10.42.42.6(pid=9344): Launched 10:34:09.833945 run osmo-stp_10.42.42.5(pid=9341): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9341)] 10:34:09.974756 run osmo-stp_10.42.42.5(pid=9341): stdout: | (launched: 2022-12-13_10:34:08.515870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:10.115864 run osmo-stp_10.42.42.5(pid=9341): stderr: | 20221213103408707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103408707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103408707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103408708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103408708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103408708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103408708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:10.254042 run osmo-stp_10.42.42.5(pid=9341): stdout: | (launched: 2022-12-13_10:34:08.515870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:10.386497 run osmo-stp_10.42.42.5(pid=9341): stderr: | 20221213103408707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103408707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103408707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103408708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103408708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103408708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103408708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:10.545021 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9341): Process ended prematurely: osmo-stp_10.42.42.5(pid=9341) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9341)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:34:10.554954 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:34:10.583174 run osmo-hlr_10.42.42.2(pid=9338): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9338)] 10:34:10.634683 run osmo-hlr_10.42.42.2(pid=9338): stdout: | (launched: 2022-12-13_10:34:07.481076) 10:34:10.687626 run osmo-hlr_10.42.42.2(pid=9338): stderr: | 20221213103407677 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103407677 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103407678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103407678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103407678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103407678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103407690 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103407698 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103407698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103407698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:10.761712 run osmo-msc_10.42.42.6(pid=9344): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9344)] 10:34:10.812589 run osmo-msc_10.42.42.6(pid=9344): stdout: | (launched: 2022-12-13_10:34:09.583663) 10:34:10.865706 run osmo-msc_10.42.42.6(pid=9344): stderr: | 20221213103409905 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103409906 DLGLOBAL DEBUG validating counter group 0x7fc046c4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103409906 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103409906 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103409906 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103409906 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103409908 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103409908 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103409908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103409908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:34:10.919375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9337): Terminating (SIGTERM) 10:34:10.961563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9340): Terminating (SIGTERM) 10:34:11.004769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9343): Terminating (SIGTERM) 10:34:11.047686 --- ParallelTerminationStrategy: PID 9337 died... 10:34:11.068506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9337): Terminated: ok {rc=0} 10:34:11.115890 --- ParallelTerminationStrategy: PID 9340 died... 10:34:11.135893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9340): Terminated: ok {rc=0} 10:34:11.182894 --- ParallelTerminationStrategy: PID 9343 died... 10:34:11.203130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9343): Terminated: ok {rc=0} 10:34:11.291584 bus /sierra_3: Setting Powered False 10:34:12.392297 bus /sierra_3: Setting Powered False 10:34:13.510295 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:34:14.662813 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:14.675926 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:34:14.750438 tst mo_mt_call_osmux.py: using LAC 33345 10:34:14.882435 tst mo_mt_call_osmux.py: using RAC 195 10:34:15.012208 tst mo_mt_call_osmux.py: using CellId 33345 10:34:15.142715 tst mo_mt_call_osmux.py: using BVCI 33346 10:34:15.265353 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:15.277416 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:15.288909 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:15.300463 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:15.312502 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:15.325261 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:34:15.444363 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:34:15.563149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:16.074893 run create_hlr_db(pid=9346): Launched 10:34:16.238785 bus /sierra_2: Setting Powered False 10:34:17.301375 run create_hlr_db(pid=9346): Terminated: ok {rc=0} 10:34:17.759681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9348): Launched 10:34:18.094450 run osmo-hlr_10.42.42.2(pid=9349): Launched 10:34:18.223286 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:18.800327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9351): Launched 10:34:19.135407 run osmo-stp_10.42.42.5(pid=9352): Launched 10:34:19.262028 run osmo-msc_10.42.42.6: Starting osmo-msc 10:34:19.863024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9354): Launched 10:34:20.197183 run osmo-msc_10.42.42.6(pid=9355): Launched 10:34:20.383238 run osmo-stp_10.42.42.5(pid=9352): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9352)] 10:34:20.523115 run osmo-stp_10.42.42.5(pid=9352): stdout: | (launched: 2022-12-13_10:34:19.072740) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:20.663537 run osmo-stp_10.42.42.5(pid=9352): stderr: | 20221213103419262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103419263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103419263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103419263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103419264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103419264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103419264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:20.802702 run osmo-stp_10.42.42.5(pid=9352): stdout: | (launched: 2022-12-13_10:34:19.072740) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:20.934905 run osmo-stp_10.42.42.5(pid=9352): stderr: | 20221213103419262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103419263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103419263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103419263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103419264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103419264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103419264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:21.093168 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9352): Process ended prematurely: osmo-stp_10.42.42.5(pid=9352) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9352)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:34:21.103180 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:34:21.131179 run osmo-hlr_10.42.42.2(pid=9349): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9349)] 10:34:21.182366 run osmo-hlr_10.42.42.2(pid=9349): stdout: | (launched: 2022-12-13_10:34:18.031639) 10:34:21.235090 run osmo-hlr_10.42.42.2(pid=9349): stderr: | 20221213103418228 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103418228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103418228 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103418228 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103418228 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103418229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103418241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103418249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103418250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103418250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:21.308159 run osmo-msc_10.42.42.6(pid=9355): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9355)] 10:34:21.358700 run osmo-msc_10.42.42.6(pid=9355): stdout: | (launched: 2022-12-13_10:34:20.134692) 10:34:21.411184 run osmo-msc_10.42.42.6(pid=9355): stderr: | 20221213103420455 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103420455 DLGLOBAL DEBUG validating counter group 0x7f4d85b4dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103420455 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103420455 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103420456 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103420456 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103420458 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103420458 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103420458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103420458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:34:21.464046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9348): Terminating (SIGTERM) 10:34:21.506275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9351): Terminating (SIGTERM) 10:34:21.549523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9354): Terminating (SIGTERM) 10:34:21.592481 --- ParallelTerminationStrategy: PID 9348 died... 10:34:21.613142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9348): Terminated: ok {rc=0} 10:34:21.660170 --- ParallelTerminationStrategy: PID 9351 died... 10:34:21.680383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9351): Terminated: ok {rc=0} 10:34:21.727546 --- ParallelTerminationStrategy: PID 9354 died... 10:34:21.747683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9354): Terminated: ok {rc=0} 10:34:21.838536 bus /sierra_3: Setting Powered False 10:34:22.938742 bus /sierra_3: Setting Powered False 10:34:24.055857 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:34:25.310041 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:34:25.317355 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:34:25.352430 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:34:25.379998 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:34:25.434419 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:34:25.470681 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:34:25.498463 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:34:26.048213 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:34:26.102616 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:26.114696 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:34:26.187365 tst mo_mt_call.py: using LAC 33346 10:34:26.318941 tst mo_mt_call.py: using RAC 196 10:34:26.450138 tst mo_mt_call.py: using CellId 33346 10:34:26.581223 tst mo_mt_call.py: using BVCI 33347 10:34:26.703642 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:26.715635 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:26.727815 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:26.739656 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:26.752001 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:26.764123 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:34:26.883381 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:34:27.004883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:27.522577 run create_hlr_db(pid=9360): Launched 10:34:27.651579 bus /sierra_2: Setting Powered False 10:34:28.717621 run create_hlr_db(pid=9360): Terminated: ok {rc=0} 10:34:29.163070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9362): Launched 10:34:29.477688 run osmo-hlr_10.42.42.2(pid=9363): Launched 10:34:29.596049 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:30.145679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9365): Launched 10:34:30.457793 run osmo-stp_10.42.42.5(pid=9366): Launched 10:34:30.577448 run osmo-msc_10.42.42.6: Starting osmo-msc 10:34:31.165487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9368): Launched 10:34:31.539279 run osmo-msc_10.42.42.6(pid=9369): Launched 10:34:31.852432 run osmo-stp_10.42.42.5(pid=9366): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9366)] 10:34:32.190411 run osmo-stp_10.42.42.5(pid=9366): stdout: | (launched: 2022-12-13_10:34:30.398529) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:32.340239 run osmo-stp_10.42.42.5(pid=9366): stderr: | 20221213103430571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103430571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103430571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103430572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103430572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103430572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103430572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:32.479467 run osmo-stp_10.42.42.5(pid=9366): stdout: | (launched: 2022-12-13_10:34:30.398529) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:32.612638 run osmo-stp_10.42.42.5(pid=9366): stderr: | 20221213103430571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103430571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103430571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103430572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103430572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103430572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103430572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:32.772868 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9366): Process ended prematurely: osmo-stp_10.42.42.5(pid=9366) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9366)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:34:32.782921 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 10:34:32.811327 run osmo-hlr_10.42.42.2(pid=9363): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9363)] 10:34:32.863507 run osmo-hlr_10.42.42.2(pid=9363): stdout: | (launched: 2022-12-13_10:34:29.418665) 10:34:32.917265 run osmo-hlr_10.42.42.2(pid=9363): stderr: | 20221213103429595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103429595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103429595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103429595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103429595 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103429595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103429606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103429614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103429614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103429614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:32.991582 run osmo-msc_10.42.42.6(pid=9369): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9369)] 10:34:33.042593 run osmo-msc_10.42.42.6(pid=9369): stdout: | (launched: 2022-12-13_10:34:31.476689) 10:34:33.096026 run osmo-msc_10.42.42.6(pid=9369): stderr: | 20221213103432000 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103432000 DLGLOBAL DEBUG validating counter group 0x7fb551adec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103432000 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103432000 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103432001 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103432001 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103432002 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103432003 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103432003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103432003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:34:33.149911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9362): Terminating (SIGTERM) 10:34:33.192808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9365): Terminating (SIGTERM) 10:34:33.236312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9368): Terminating (SIGTERM) 10:34:33.279951 --- ParallelTerminationStrategy: PID 9362 died... 10:34:33.300695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9362): Terminated: ok {rc=0} 10:34:33.348679 --- ParallelTerminationStrategy: PID 9365 died... 10:34:33.369343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9365): Terminated: ok {rc=0} 10:34:33.416856 --- ParallelTerminationStrategy: PID 9368 died... 10:34:33.437490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9368): Terminated: ok {rc=0} 10:34:33.529193 bus /sierra_3: Setting Powered False 10:34:34.629491 bus /sierra_3: Setting Powered False 10:34:35.747959 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:34:36.900722 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:36.913514 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:34:36.985578 tst mo_mt_call_osmux.py: using LAC 33347 10:34:37.110585 tst mo_mt_call_osmux.py: using RAC 197 10:34:37.234403 tst mo_mt_call_osmux.py: using CellId 33347 10:34:37.355695 tst mo_mt_call_osmux.py: using BVCI 33348 10:34:37.469796 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:37.481318 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:37.492821 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:37.504113 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:37.515554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:37.526843 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:34:37.649774 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:34:37.770141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:38.256448 run create_hlr_db(pid=9371): Launched 10:34:38.386949 bus /sierra_2: Setting Powered False 10:34:39.448934 run create_hlr_db(pid=9371): Terminated: ok {rc=0} 10:34:39.905520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9373): Launched 10:34:40.240841 run osmo-hlr_10.42.42.2(pid=9374): Launched 10:34:40.369240 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:40.947916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9376): Launched 10:34:41.283227 run osmo-stp_10.42.42.5(pid=9377): Launched 10:34:41.409888 run osmo-msc_10.42.42.6: Starting osmo-msc 10:34:42.013098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9379): Launched 10:34:42.347812 run osmo-msc_10.42.42.6(pid=9380): Launched 10:34:42.532554 run osmo-stp_10.42.42.5(pid=9377): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9377)] 10:34:42.673141 run osmo-stp_10.42.42.5(pid=9377): stdout: | (launched: 2022-12-13_10:34:41.220237) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:42.815249 run osmo-stp_10.42.42.5(pid=9377): stderr: | 20221213103441411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103441411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103441412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103441412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103441412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103441413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103441413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:42.953913 run osmo-stp_10.42.42.5(pid=9377): stdout: | (launched: 2022-12-13_10:34:41.220237) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:43.086659 run osmo-stp_10.42.42.5(pid=9377): stderr: | 20221213103441411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103441411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103441412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103441412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103441412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103441413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103441413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:43.245418 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9377): Process ended prematurely: osmo-stp_10.42.42.5(pid=9377) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9377)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:34:43.255378 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:34:43.283280 run osmo-hlr_10.42.42.2(pid=9374): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9374)] 10:34:43.334435 run osmo-hlr_10.42.42.2(pid=9374): stdout: | (launched: 2022-12-13_10:34:40.178331) 10:34:43.387681 run osmo-hlr_10.42.42.2(pid=9374): stderr: | 20221213103440375 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103440375 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103440375 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103440375 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103440375 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103440375 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103440387 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103440395 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103440396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103440396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:43.461075 run osmo-msc_10.42.42.6(pid=9380): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9380)] 10:34:43.511596 run osmo-msc_10.42.42.6(pid=9380): stdout: | (launched: 2022-12-13_10:34:42.284756) 10:34:43.563926 run osmo-msc_10.42.42.6(pid=9380): stderr: | 20221213103442606 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103442606 DLGLOBAL DEBUG validating counter group 0x7f847c3a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103442606 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103442606 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103442606 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103442606 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103442608 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103442609 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103442609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103442609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:34:43.617397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9373): Terminating (SIGTERM) 10:34:43.659642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9376): Terminating (SIGTERM) 10:34:43.702607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9379): Terminating (SIGTERM) 10:34:43.746037 --- ParallelTerminationStrategy: PID 9373 died... 10:34:43.766844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9373): Terminated: ok {rc=0} 10:34:43.814183 --- ParallelTerminationStrategy: PID 9376 died... 10:34:43.834235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9376): Terminated: ok {rc=0} 10:34:43.881364 --- ParallelTerminationStrategy: PID 9379 died... 10:34:43.901566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9379): Terminated: ok {rc=0} 10:34:43.991561 bus /sierra_3: Setting Powered False 10:34:45.090598 bus /sierra_3: Setting Powered False 10:34:46.213147 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:34:47.486858 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:34:47.494168 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:34:47.529924 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:34:47.557884 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:34:47.612255 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:34:47.646724 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:34:47.674137 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:34:48.226938 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:34:48.277222 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:48.288489 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:34:48.357311 tst mo_mt_call.py: using LAC 33348 10:34:48.478395 tst mo_mt_call.py: using RAC 198 10:34:48.604835 tst mo_mt_call.py: using CellId 33348 10:34:48.730567 tst mo_mt_call.py: using BVCI 33349 10:34:48.852831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:48.864718 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:48.876446 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:48.887999 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:48.900075 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:48.911870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:34:49.030165 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:34:49.147725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:49.630924 run create_hlr_db(pid=9385): Launched 10:34:49.759309 bus /sierra_2: Setting Powered False 10:34:50.821338 run create_hlr_db(pid=9385): Terminated: ok {rc=0} 10:34:51.277664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9387): Launched 10:34:51.614096 run osmo-hlr_10.42.42.2(pid=9388): Launched 10:34:51.741255 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:52.319128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9390): Launched 10:34:52.652382 run osmo-stp_10.42.42.5(pid=9391): Launched 10:34:52.779836 run osmo-msc_10.42.42.6: Starting osmo-msc 10:34:53.381633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9393): Launched 10:34:53.717019 run osmo-msc_10.42.42.6(pid=9394): Launched 10:34:53.903743 run osmo-stp_10.42.42.5(pid=9391): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9391)] 10:34:54.044152 run osmo-stp_10.42.42.5(pid=9391): stdout: | (launched: 2022-12-13_10:34:52.590081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:54.184505 run osmo-stp_10.42.42.5(pid=9391): stderr: | 20221213103452781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103452781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103452781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103452781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103452782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103452782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103452782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:54.323275 run osmo-stp_10.42.42.5(pid=9391): stdout: | (launched: 2022-12-13_10:34:52.590081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:54.455829 run osmo-stp_10.42.42.5(pid=9391): stderr: | 20221213103452781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103452781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103452781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103452781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103452782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103452782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103452782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:54.614344 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9391): Process ended prematurely: osmo-stp_10.42.42.5(pid=9391) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9391)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:34:54.623915 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:34:54.652049 run osmo-hlr_10.42.42.2(pid=9388): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9388)] 10:34:54.703144 run osmo-hlr_10.42.42.2(pid=9388): stdout: | (launched: 2022-12-13_10:34:51.551180) 10:34:54.756146 run osmo-hlr_10.42.42.2(pid=9388): stderr: | 20221213103451748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103451748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103451749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103451749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103451749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103451749 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103451765 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103451774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103451775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103451775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:54.829147 run osmo-msc_10.42.42.6(pid=9394): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9394)] 10:34:54.879553 run osmo-msc_10.42.42.6(pid=9394): stdout: | (launched: 2022-12-13_10:34:53.654332) 10:34:54.932268 run osmo-msc_10.42.42.6(pid=9394): stderr: | 20221213103453974 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103453974 DLGLOBAL DEBUG validating counter group 0x7fc9265b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103453974 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103453974 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103453975 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103453975 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103453976 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103453977 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103453977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103453977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:34:54.985129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9387): Terminating (SIGTERM) 10:34:55.027272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9390): Terminating (SIGTERM) 10:34:55.069662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9393): Terminating (SIGTERM) 10:34:55.112745 --- ParallelTerminationStrategy: PID 9387 died... 10:34:55.133331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9387): Terminated: ok {rc=0} 10:34:55.180053 --- ParallelTerminationStrategy: PID 9390 died... 10:34:55.200069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9390): Terminated: ok {rc=0} 10:34:55.246392 --- ParallelTerminationStrategy: PID 9393 died... 10:34:55.266385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9393): Terminated: ok {rc=0} 10:34:55.356022 bus /sierra_3: Setting Powered False 10:34:56.455558 bus /sierra_3: Setting Powered False 10:34:57.573359 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:34:58.724383 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:58.737456 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:34:58.809802 tst mo_mt_call_osmux.py: using LAC 33349 10:34:58.939489 tst mo_mt_call_osmux.py: using RAC 199 10:34:59.069458 tst mo_mt_call_osmux.py: using CellId 33349 10:34:59.201579 tst mo_mt_call_osmux.py: using BVCI 33350 10:34:59.321854 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:59.333881 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:59.345805 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:59.357770 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:59.369985 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:59.382183 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:34:59.505101 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:34:59.625644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:00.111456 run create_hlr_db(pid=9397): Launched 10:35:00.240541 bus /sierra_2: Setting Powered False 10:35:01.308227 run create_hlr_db(pid=9397): Terminated: ok {rc=0} 10:35:01.783386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9402): Launched 10:35:02.133301 run osmo-hlr_10.42.42.2(pid=9403): Launched 10:35:02.273924 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:02.852484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9405): Launched 10:35:03.188727 run osmo-stp_10.42.42.5(pid=9406): Launched 10:35:03.316694 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:03.919043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9408): Launched 10:35:04.255440 run osmo-msc_10.42.42.6(pid=9409): Launched 10:35:04.443524 run osmo-stp_10.42.42.5(pid=9406): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9406)] 10:35:04.584142 run osmo-stp_10.42.42.5(pid=9406): stdout: | (launched: 2022-12-13_10:35:03.126212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:04.725557 run osmo-stp_10.42.42.5(pid=9406): stderr: | 20221213103503318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103503318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103503318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103503319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103503319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103503319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103503319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:04.864879 run osmo-stp_10.42.42.5(pid=9406): stdout: | (launched: 2022-12-13_10:35:03.126212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:04.998051 run osmo-stp_10.42.42.5(pid=9406): stderr: | 20221213103503318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103503318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103503318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103503319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103503319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103503319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103503319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:05.157320 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9406): Process ended prematurely: osmo-stp_10.42.42.5(pid=9406) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9406)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:35:05.167219 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:35:05.195223 run osmo-hlr_10.42.42.2(pid=9403): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9403)] 10:35:05.246175 run osmo-hlr_10.42.42.2(pid=9403): stdout: | (launched: 2022-12-13_10:35:02.070855) 10:35:05.298893 run osmo-hlr_10.42.42.2(pid=9403): stderr: | 20221213103502284 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103502284 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103502284 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103502284 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103502284 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103502284 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103502296 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103502305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103502305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103502305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:05.372702 run osmo-msc_10.42.42.6(pid=9409): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9409)] 10:35:05.423033 run osmo-msc_10.42.42.6(pid=9409): stdout: | (launched: 2022-12-13_10:35:04.192015) 10:35:05.475840 run osmo-msc_10.42.42.6(pid=9409): stderr: | 20221213103504514 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103504514 DLGLOBAL DEBUG validating counter group 0x7f1632884c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103504515 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103504515 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103504515 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103504515 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103504517 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103504517 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103504517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103504517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:05.528913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9402): Terminating (SIGTERM) 10:35:05.571122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9405): Terminating (SIGTERM) 10:35:05.613521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9408): Terminating (SIGTERM) 10:35:05.656257 --- ParallelTerminationStrategy: PID 9402 died... 10:35:05.677061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9402): Terminated: ok {rc=0} 10:35:05.724075 --- ParallelTerminationStrategy: PID 9405 died... 10:35:05.744723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9405): Terminated: ok {rc=0} 10:35:05.791742 --- ParallelTerminationStrategy: PID 9408 died... 10:35:05.812012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9408): Terminated: ok {rc=0} 10:35:05.900913 bus /sierra_3: Setting Powered False 10:35:07.000576 bus /sierra_3: Setting Powered False 10:35:08.123678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:35:09.377180 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:09.383698 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:35:09.416937 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:35:09.443494 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:35:09.496035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:35:09.531037 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:35:09.559011 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:35:10.106946 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:35:10.156824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:10.168245 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:35:10.238580 tst mo_mt_call.py: using LAC 33350 10:35:10.362907 tst mo_mt_call.py: using RAC 200 10:35:10.487794 tst mo_mt_call.py: using CellId 33350 10:35:10.611414 tst mo_mt_call.py: using BVCI 33351 10:35:10.723602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:10.734824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:10.745941 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:10.757172 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:10.768275 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:10.779325 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:35:10.901472 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:35:11.024400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:11.542679 run create_hlr_db(pid=9415): Launched 10:35:11.671787 bus /sierra_2: Setting Powered False 10:35:12.737781 run create_hlr_db(pid=9415): Terminated: ok {rc=0} 10:35:13.184463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9417): Launched 10:35:13.498990 run osmo-hlr_10.42.42.2(pid=9418): Launched 10:35:13.619494 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:14.154502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9420): Launched 10:35:14.468256 run osmo-stp_10.42.42.5(pid=9421): Launched 10:35:14.587284 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:15.149441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9423): Launched 10:35:15.460191 run osmo-msc_10.42.42.6(pid=9424): Launched 10:35:15.634301 run osmo-stp_10.42.42.5(pid=9421): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9421)] 10:35:15.764390 run osmo-stp_10.42.42.5(pid=9421): stdout: | (launched: 2022-12-13_10:35:14.408508) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:15.911875 run osmo-stp_10.42.42.5(pid=9421): stderr: | 20221213103514581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103514581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103514581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103514582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103514582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103514582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103514582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:16.054890 run osmo-stp_10.42.42.5(pid=9421): stdout: | (launched: 2022-12-13_10:35:14.408508) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:16.192468 run osmo-stp_10.42.42.5(pid=9421): stderr: | 20221213103514581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103514581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103514581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103514582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103514582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103514582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103514582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:16.357892 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9421): Process ended prematurely: osmo-stp_10.42.42.5(pid=9421) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9421)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:35:16.368595 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:35:16.397972 run osmo-hlr_10.42.42.2(pid=9418): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9418)] 10:35:16.454584 run osmo-hlr_10.42.42.2(pid=9418): stdout: | (launched: 2022-12-13_10:35:13.440187) 10:35:16.510981 run osmo-hlr_10.42.42.2(pid=9418): stderr: | 20221213103513616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103513616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103513616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103513616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103513616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103513616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103513628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103513636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103513637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103513637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:16.587176 run osmo-msc_10.42.42.6(pid=9424): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9424)] 10:35:16.640398 run osmo-msc_10.42.42.6(pid=9424): stdout: | (launched: 2022-12-13_10:35:15.401058) 10:35:16.697643 run osmo-msc_10.42.42.6(pid=9424): stderr: | 20221213103515675 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103515675 DLGLOBAL DEBUG validating counter group 0x7fcc23ce1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103515675 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103515675 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103515675 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103515676 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103515678 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103515678 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103515678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103515678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:16.752750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9417): Terminating (SIGTERM) 10:35:16.803073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9420): Terminating (SIGTERM) 10:35:16.851504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9423): Terminating (SIGTERM) 10:35:16.902398 --- ParallelTerminationStrategy: PID 9417 died... 10:35:16.925852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9417): Terminated: ok {rc=0} 10:35:16.981307 --- ParallelTerminationStrategy: PID 9420 died... 10:35:17.005343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9420): Terminated: ok {rc=0} 10:35:17.060637 --- ParallelTerminationStrategy: PID 9423 died... 10:35:17.085216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9423): Terminated: ok {rc=0} 10:35:17.179894 bus /sierra_3: Setting Powered False 10:35:18.280226 bus /sierra_3: Setting Powered False 10:35:19.392500 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:35:20.544091 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:20.556829 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:35:20.630365 tst mo_mt_call_osmux.py: using LAC 33351 10:35:20.761471 tst mo_mt_call_osmux.py: using RAC 201 10:35:20.893590 tst mo_mt_call_osmux.py: using CellId 33351 10:35:21.025394 tst mo_mt_call_osmux.py: using BVCI 33352 10:35:21.147990 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:21.159841 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:21.171539 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:21.183249 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:21.195400 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:21.207449 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:35:21.330980 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:35:21.451473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:21.937080 run create_hlr_db(pid=9426): Launched 10:35:22.065924 bus /sierra_2: Setting Powered False 10:35:23.127822 run create_hlr_db(pid=9426): Terminated: ok {rc=0} 10:35:23.583682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9428): Launched 10:35:23.919535 run osmo-hlr_10.42.42.2(pid=9429): Launched 10:35:24.047673 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:24.622719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9431): Launched 10:35:24.958862 run osmo-stp_10.42.42.5(pid=9432): Launched 10:35:25.085141 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:25.688071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9434): Launched 10:35:26.023707 run osmo-msc_10.42.42.6(pid=9435): Launched 10:35:26.210822 run osmo-stp_10.42.42.5(pid=9432): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9432)] 10:35:26.351108 run osmo-stp_10.42.42.5(pid=9432): stdout: | (launched: 2022-12-13_10:35:24.895888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:26.491831 run osmo-stp_10.42.42.5(pid=9432): stderr: | 20221213103525087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103525088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103525088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103525088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103525089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103525089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103525089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:26.631128 run osmo-stp_10.42.42.5(pid=9432): stdout: | (launched: 2022-12-13_10:35:24.895888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:26.764518 run osmo-stp_10.42.42.5(pid=9432): stderr: | 20221213103525087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103525088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103525088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103525088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103525089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103525089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103525089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:26.923609 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9432): Process ended prematurely: osmo-stp_10.42.42.5(pid=9432) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9432)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:35:26.933715 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:35:26.961797 run osmo-hlr_10.42.42.2(pid=9429): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9429)] 10:35:27.013502 run osmo-hlr_10.42.42.2(pid=9429): stdout: | (launched: 2022-12-13_10:35:23.856682) 10:35:27.066107 run osmo-hlr_10.42.42.2(pid=9429): stderr: | 20221213103524053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103524053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103524053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103524053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103524053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103524053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103524064 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103524076 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103524076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103524076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:27.140171 run osmo-msc_10.42.42.6(pid=9435): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9435)] 10:35:27.190716 run osmo-msc_10.42.42.6(pid=9435): stdout: | (launched: 2022-12-13_10:35:25.960656) 10:35:27.243155 run osmo-msc_10.42.42.6(pid=9435): stderr: | 20221213103526281 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103526282 DLGLOBAL DEBUG validating counter group 0x7f0b4136ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103526282 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103526282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103526282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103526282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103526284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103526284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103526285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103526285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:27.296327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9428): Terminating (SIGTERM) 10:35:27.339271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9431): Terminating (SIGTERM) 10:35:27.382433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9434): Terminating (SIGTERM) 10:35:27.425726 --- ParallelTerminationStrategy: PID 9428 died... 10:35:27.446332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9428): Terminated: ok {rc=0} 10:35:27.493313 --- ParallelTerminationStrategy: PID 9431 died... 10:35:27.513351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9431): Terminated: ok {rc=0} 10:35:27.559978 --- ParallelTerminationStrategy: PID 9434 died... 10:35:27.580029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9434): Terminated: ok {rc=0} 10:35:27.670918 bus /sierra_3: Setting Powered False 10:35:28.771370 bus /sierra_3: Setting Powered False 10:35:29.888437 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:35:31.151347 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:31.159391 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:35:31.197344 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:35:31.226919 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:35:31.283998 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:35:31.331677 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:35:31.367635 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:35:31.901637 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:35:31.956488 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:31.968897 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:35:32.056057 tst mo_mt_call.py: using LAC 33352 10:35:32.236942 tst mo_mt_call.py: using RAC 202 10:35:32.378375 tst mo_mt_call.py: using CellId 33352 10:35:32.509514 tst mo_mt_call.py: using BVCI 33353 10:35:32.623700 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:32.635191 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:32.646624 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:32.657921 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:32.669402 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:32.680631 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:35:32.804552 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:35:32.924893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:33.406845 run create_hlr_db(pid=9440): Launched 10:35:33.534470 bus /sierra_2: Setting Powered False 10:35:34.596497 run create_hlr_db(pid=9440): Terminated: ok {rc=0} 10:35:35.051707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9442): Launched 10:35:35.387021 run osmo-hlr_10.42.42.2(pid=9443): Launched 10:35:35.513974 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:36.088756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9445): Launched 10:35:36.422657 run osmo-stp_10.42.42.5(pid=9446): Launched 10:35:36.548879 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:37.151575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9448): Launched 10:35:37.488103 run osmo-msc_10.42.42.6(pid=9449): Launched 10:35:37.674902 run osmo-stp_10.42.42.5(pid=9446): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9446)] 10:35:37.815805 run osmo-stp_10.42.42.5(pid=9446): stdout: | (launched: 2022-12-13_10:35:36.359779) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:37.956577 run osmo-stp_10.42.42.5(pid=9446): stderr: | 20221213103536552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103536552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103536552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103536553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103536553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103536553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103536553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:38.095597 run osmo-stp_10.42.42.5(pid=9446): stdout: | (launched: 2022-12-13_10:35:36.359779) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:38.228564 run osmo-stp_10.42.42.5(pid=9446): stderr: | 20221213103536552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103536552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103536552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103536553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103536553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103536553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103536553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:38.387947 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9446): Process ended prematurely: osmo-stp_10.42.42.5(pid=9446) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9446)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:35:38.397895 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:35:38.425807 run osmo-hlr_10.42.42.2(pid=9443): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9443)] 10:35:38.476772 run osmo-hlr_10.42.42.2(pid=9443): stdout: | (launched: 2022-12-13_10:35:35.324481) 10:35:38.529925 run osmo-hlr_10.42.42.2(pid=9443): stderr: | 20221213103535522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103535522 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103535522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103535522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103535522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103535522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103535535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103535544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103535545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103535545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:38.603584 run osmo-msc_10.42.42.6(pid=9449): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9449)] 10:35:38.654471 run osmo-msc_10.42.42.6(pid=9449): stdout: | (launched: 2022-12-13_10:35:37.425331) 10:35:38.707791 run osmo-msc_10.42.42.6(pid=9449): stderr: | 20221213103537746 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103537747 DLGLOBAL DEBUG validating counter group 0x7ff1c7659c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103537747 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103537747 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103537747 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103537747 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103537749 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103537749 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103537749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103537749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:38.761333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9442): Terminating (SIGTERM) 10:35:38.803708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9445): Terminating (SIGTERM) 10:35:38.846805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9448): Terminating (SIGTERM) 10:35:38.889788 --- ParallelTerminationStrategy: PID 9442 died... 10:35:38.910389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9442): Terminated: ok {rc=0} 10:35:38.957452 --- ParallelTerminationStrategy: PID 9445 died... 10:35:38.977511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9445): Terminated: ok {rc=0} 10:35:39.024264 --- ParallelTerminationStrategy: PID 9448 died... 10:35:39.044390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9448): Terminated: ok {rc=0} 10:35:39.134103 bus /sierra_3: Setting Powered False 10:35:40.234585 bus /sierra_3: Setting Powered False 10:35:41.353430 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:35:42.499034 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:42.511138 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:35:42.582348 tst mo_mt_call_osmux.py: using LAC 33353 10:35:42.707496 tst mo_mt_call_osmux.py: using RAC 203 10:35:42.831558 tst mo_mt_call_osmux.py: using CellId 33353 10:35:42.954986 tst mo_mt_call_osmux.py: using BVCI 33354 10:35:43.069254 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:43.080464 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:43.091639 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:43.102831 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:43.114314 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:43.125602 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:35:43.243197 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:35:43.367018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:43.885646 run create_hlr_db(pid=9451): Launched 10:35:44.013312 bus /sierra_2: Setting Powered False 10:35:45.079092 run create_hlr_db(pid=9451): Terminated: ok {rc=0} 10:35:45.526950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9453): Launched 10:35:45.839880 run osmo-hlr_10.42.42.2(pid=9454): Launched 10:35:46.075761 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:46.753673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9456): Launched 10:35:47.079628 run osmo-stp_10.42.42.5(pid=9457): Launched 10:35:47.323661 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:47.897388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9459): Launched 10:35:48.209823 run osmo-msc_10.42.42.6(pid=9460): Launched 10:35:48.382184 run osmo-stp_10.42.42.5(pid=9457): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9457)] 10:35:48.512142 run osmo-stp_10.42.42.5(pid=9457): stdout: | (launched: 2022-12-13_10:35:47.019260) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:48.642646 run osmo-stp_10.42.42.5(pid=9457): stderr: | 20221213103547291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103547291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103547292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103547292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103547293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103547293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103547293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:48.772329 run osmo-stp_10.42.42.5(pid=9457): stdout: | (launched: 2022-12-13_10:35:47.019260) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:48.896156 run osmo-stp_10.42.42.5(pid=9457): stderr: | 20221213103547291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103547291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103547292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103547292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103547293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103547293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103547293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:49.044196 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9457): Process ended prematurely: osmo-stp_10.42.42.5(pid=9457) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9457)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:35:49.053442 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:35:49.080137 run osmo-hlr_10.42.42.2(pid=9454): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9454)] 10:35:49.128695 run osmo-hlr_10.42.42.2(pid=9454): stdout: | (launched: 2022-12-13_10:35:45.780685) 10:35:49.178838 run osmo-hlr_10.42.42.2(pid=9454): stderr: | 20221213103546030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103546030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103546030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103546030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103546030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103546030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103546045 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103546055 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103546055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103546056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:49.248405 run osmo-msc_10.42.42.6(pid=9460): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9460)] 10:35:49.296355 run osmo-msc_10.42.42.6(pid=9460): stdout: | (launched: 2022-12-13_10:35:48.150706) 10:35:49.345908 run osmo-msc_10.42.42.6(pid=9460): stderr: | 20221213103548425 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103548425 DLGLOBAL DEBUG validating counter group 0x7f6b12710c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103548425 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103548425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103548426 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103548426 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103548427 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103548428 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103548428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103548428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:49.395979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9453): Terminating (SIGTERM) 10:35:49.436001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9456): Terminating (SIGTERM) 10:35:49.476237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9459): Terminating (SIGTERM) 10:35:49.516559 --- ParallelTerminationStrategy: PID 9453 died... 10:35:49.536056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9453): Terminated: ok {rc=0} 10:35:49.580521 --- ParallelTerminationStrategy: PID 9456 died... 10:35:49.599554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9456): Terminated: ok {rc=0} 10:35:49.643868 --- ParallelTerminationStrategy: PID 9459 died... 10:35:49.663004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9459): Terminated: ok {rc=0} 10:35:49.749460 bus /sierra_3: Setting Powered False 10:35:50.851130 bus /sierra_3: Setting Powered False 10:35:51.967674 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:35:53.234510 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:53.240352 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:35:53.273818 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:35:53.300775 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:35:53.355050 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:35:53.391263 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:35:53.419207 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:35:53.963033 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:35:54.013441 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:54.024761 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:35:54.095589 tst mo_mt_call.py: using LAC 33354 10:35:54.217318 tst mo_mt_call.py: using RAC 204 10:35:54.341090 tst mo_mt_call.py: using CellId 33354 10:35:54.464036 tst mo_mt_call.py: using BVCI 33355 10:35:54.577821 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:54.589121 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:54.599917 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:54.610787 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:54.621945 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:54.632736 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:35:54.755320 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:35:54.874966 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:55.358991 run create_hlr_db(pid=9467): Launched 10:35:55.488212 bus /sierra_2: Setting Powered False 10:35:56.549131 run create_hlr_db(pid=9467): Terminated: ok {rc=0} 10:35:57.006005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9469): Launched 10:35:57.340711 run osmo-hlr_10.42.42.2(pid=9470): Launched 10:35:57.469756 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:58.047545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9472): Launched 10:35:58.383900 run osmo-stp_10.42.42.5(pid=9473): Launched 10:35:58.512347 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:59.119674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9475): Launched 10:35:59.455623 run osmo-msc_10.42.42.6(pid=9476): Launched 10:35:59.641862 run osmo-stp_10.42.42.5(pid=9473): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9473)] 10:35:59.782799 run osmo-stp_10.42.42.5(pid=9473): stdout: | (launched: 2022-12-13_10:35:58.320924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:59.923966 run osmo-stp_10.42.42.5(pid=9473): stderr: | 20221213103558511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103558511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103558512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103558512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103558513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103558513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103558513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:00.063294 run osmo-stp_10.42.42.5(pid=9473): stdout: | (launched: 2022-12-13_10:35:58.320924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:00.196769 run osmo-stp_10.42.42.5(pid=9473): stderr: | 20221213103558511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103558511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103558512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103558512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103558513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103558513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103558513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:00.356493 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9473): Process ended prematurely: osmo-stp_10.42.42.5(pid=9473) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9473)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:36:00.366450 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:36:00.394464 run osmo-hlr_10.42.42.2(pid=9470): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9470)] 10:36:00.446616 run osmo-hlr_10.42.42.2(pid=9470): stdout: | (launched: 2022-12-13_10:35:57.278021) 10:36:00.499835 run osmo-hlr_10.42.42.2(pid=9470): stderr: | 20221213103557474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103557474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103557474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103557474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103557474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103557474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103557487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103557498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103557498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103557498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:00.573478 run osmo-msc_10.42.42.6(pid=9476): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9476)] 10:36:00.624330 run osmo-msc_10.42.42.6(pid=9476): stdout: | (launched: 2022-12-13_10:35:59.392429) 10:36:00.677264 run osmo-msc_10.42.42.6(pid=9476): stderr: | 20221213103559715 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103559715 DLGLOBAL DEBUG validating counter group 0x7f837da59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103559715 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103559715 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103559715 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103559715 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103559717 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103559717 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103559718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103559718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:36:00.730526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9469): Terminating (SIGTERM) 10:36:00.773190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9472): Terminating (SIGTERM) 10:36:00.817038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9475): Terminating (SIGTERM) 10:36:00.866957 --- ParallelTerminationStrategy: PID 9469 died... 10:36:00.897766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9469): Terminated: ok {rc=0} 10:36:00.943940 --- ParallelTerminationStrategy: PID 9472 died... 10:36:00.963883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9472): Terminated: ok {rc=0} 10:36:01.020011 --- ParallelTerminationStrategy: PID 9475 died... 10:36:01.041873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9475): Terminated: ok {rc=0} 10:36:01.136732 bus /sierra_3: Setting Powered False 10:36:02.249604 bus /sierra_3: Setting Powered False 10:36:03.368310 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:36:04.521722 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:36:04.534750 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:36:04.611287 tst mo_mt_call_osmux.py: using LAC 33355 10:36:04.736797 tst mo_mt_call_osmux.py: using RAC 205 10:36:04.862611 tst mo_mt_call_osmux.py: using CellId 33355 10:36:04.987438 tst mo_mt_call_osmux.py: using BVCI 33356 10:36:05.102199 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:36:05.113628 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:36:05.124564 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:36:05.135627 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:36:05.146635 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:36:05.157726 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:36:05.274080 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:36:05.401975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:05.921340 run create_hlr_db(pid=9478): Launched 10:36:06.048477 bus /sierra_2: Setting Powered False 10:36:07.114344 run create_hlr_db(pid=9478): Terminated: ok {rc=0} 10:36:07.579924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9480): Launched 10:36:07.915870 run osmo-hlr_10.42.42.2(pid=9481): Launched 10:36:08.044869 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:08.621946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9483): Launched 10:36:08.958260 run osmo-stp_10.42.42.5(pid=9484): Launched 10:36:09.086326 run osmo-msc_10.42.42.6: Starting osmo-msc 10:36:09.688038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9486): Launched 10:36:10.025396 run osmo-msc_10.42.42.6(pid=9487): Launched 10:36:10.210465 run osmo-stp_10.42.42.5(pid=9484): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9484)] 10:36:10.350021 run osmo-stp_10.42.42.5(pid=9484): stdout: | (launched: 2022-12-13_10:36:08.895441) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:10.490127 run osmo-stp_10.42.42.5(pid=9484): stderr: | 20221213103609087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103609087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103609088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103609088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103609088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103609089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103609089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:10.627814 run osmo-stp_10.42.42.5(pid=9484): stdout: | (launched: 2022-12-13_10:36:08.895441) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:10.759986 run osmo-stp_10.42.42.5(pid=9484): stderr: | 20221213103609087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103609087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103609088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103609088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103609088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103609089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103609089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:10.918971 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9484): Process ended prematurely: osmo-stp_10.42.42.5(pid=9484) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9484)] [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:36:10.928679 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:36:10.956646 run osmo-hlr_10.42.42.2(pid=9481): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9481)] 10:36:11.007525 run osmo-hlr_10.42.42.2(pid=9481): stdout: | (launched: 2022-12-13_10:36:07.852839) 10:36:11.059775 run osmo-hlr_10.42.42.2(pid=9481): stderr: | 20221213103608049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103608049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103608049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103608049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103608049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103608049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103608061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103608070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103608070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103608070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:11.132871 run osmo-msc_10.42.42.6(pid=9487): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9487)] 10:36:11.183251 run osmo-msc_10.42.42.6(pid=9487): stdout: | (launched: 2022-12-13_10:36:09.962815) 10:36:11.235853 run osmo-msc_10.42.42.6(pid=9487): stderr: | 20221213103610283 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103610283 DLGLOBAL DEBUG validating counter group 0x7f0b45077c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103610284 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103610284 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103610284 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103610284 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103610286 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103610286 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103610286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103610286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:36:11.288445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9480): Terminating (SIGTERM) 10:36:11.330897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9483): Terminating (SIGTERM) 10:36:11.373171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9486): Terminating (SIGTERM) 10:36:11.415724 --- ParallelTerminationStrategy: PID 9480 died... 10:36:11.436331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9480): Terminated: ok {rc=0} 10:36:11.483101 --- ParallelTerminationStrategy: PID 9483 died... 10:36:11.503144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9483): Terminated: ok {rc=0} 10:36:11.549856 --- ParallelTerminationStrategy: PID 9486 died... 10:36:11.569965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9486): Terminated: ok {rc=0} 10:36:11.658980 bus /sierra_3: Setting Powered False 10:36:12.757674 bus /sierra_3: Setting Powered False 10:36:13.875454 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 10:36:15.125247 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:36:15.129856 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:36:15.163208 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 10:36:15.189822 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 10:36:15.275064 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:36:15.308515 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 10:36:15.335065 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 10:36:15.925172 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2388 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 10:36:15.931189 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:36:15.942986 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:36:15.994468 tst emergency_mo_mt_call.py: using LAC 33356 10:36:16.114862 tst emergency_mo_mt_call.py: using RAC 206 10:36:16.250534 tst emergency_mo_mt_call.py: using CellId 33356 10:36:16.383568 tst emergency_mo_mt_call.py: using BVCI 33357 10:36:16.547103 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:36:16.564894 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:36:16.581413 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:36:16.595534 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:36:16.609669 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:36:16.621159 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:36:16.739761 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:36:16.859833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:17.382933 run create_hlr_db(pid=9492): Launched 10:36:17.509445 bus /sierra_2: Setting Powered False 10:36:18.573663 run create_hlr_db(pid=9492): Terminated: ok {rc=0} 10:36:19.032777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9494): Launched 10:36:19.363515 run osmo-hlr_10.42.42.2(pid=9495): Launched 10:36:19.489096 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:20.057196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9497): Launched 10:36:20.388173 run osmo-stp_10.42.42.5(pid=9498): Launched 10:36:20.524373 tst emergency_mo_mt_call.py: using MSISDN 8111 10:36:20.697603 run osmo-msc_10.42.42.6: Starting osmo-msc 10:36:21.289361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9500): Launched 10:36:21.619731 run osmo-msc_10.42.42.6(pid=9501): Launched 10:36:21.805134 run osmo-stp_10.42.42.5(pid=9498): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9498)] 10:36:21.943619 run osmo-stp_10.42.42.5(pid=9498): stdout: | (launched: 2022-12-13_10:36:20.325999) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:22.082646 run osmo-stp_10.42.42.5(pid=9498): stderr: | 20221213103620517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103620517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103620517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103620518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103620518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103620518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103620518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:22.219954 run osmo-stp_10.42.42.5(pid=9498): stdout: | (launched: 2022-12-13_10:36:20.325999) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:22.350934 run osmo-stp_10.42.42.5(pid=9498): stderr: | 20221213103620517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103620517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103620517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103620518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103620518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103620518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103620518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:22.507334 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9498): Process ended prematurely: osmo-stp_10.42.42.5(pid=9498) [trial-2388↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9498)] [trial-2388↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 10:36:22.516567 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 10:36:22.544485 run osmo-hlr_10.42.42.2(pid=9495): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9495)] 10:36:22.597405 run osmo-hlr_10.42.42.2(pid=9495): stdout: | (launched: 2022-12-13_10:36:19.301406) 10:36:22.651600 run osmo-hlr_10.42.42.2(pid=9495): stderr: | 20221213103619500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103619500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103619500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103619500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103619500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103619500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103619514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103619522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103619523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103619523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:22.725818 run osmo-msc_10.42.42.6(pid=9501): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9501)] 10:36:22.776851 run osmo-msc_10.42.42.6(pid=9501): stdout: | (launched: 2022-12-13_10:36:21.557602) 10:36:22.830683 run osmo-msc_10.42.42.6(pid=9501): stderr: | 20221213103621877 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103621878 DLGLOBAL DEBUG validating counter group 0x7fe5900cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103621878 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103621878 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103621878 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103621878 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103621880 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103621880 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103621880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103621881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:36:22.884435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9494): Terminating (SIGTERM) 10:36:22.927639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9497): Terminating (SIGTERM) 10:36:22.971220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9500): Terminating (SIGTERM) 10:36:23.015172 --- ParallelTerminationStrategy: PID 9494 died... 10:36:23.036444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9494): Terminated: ok {rc=0} 10:36:23.084390 --- ParallelTerminationStrategy: PID 9497 died... 10:36:23.105575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9497): Terminated: ok {rc=0} 10:36:23.153209 --- ParallelTerminationStrategy: PID 9500 died... 10:36:23.173932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9500): Terminated: ok {rc=0} 10:36:23.264593 bus /sierra_3: Setting Powered False 10:36:24.365472 bus /sierra_3: Setting Powered False 10:36:25.483364 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 10:36:26.571572 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:36:26.583794 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:36:26.638241 tst emergency_preemptive_call.py: using LAC 33357 10:36:26.767292 tst emergency_preemptive_call.py: using RAC 207 10:36:26.895585 tst emergency_preemptive_call.py: using CellId 33357 10:36:27.023510 tst emergency_preemptive_call.py: using BVCI 33358 10:36:27.135684 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:36:27.146726 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:36:27.157646 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:36:27.168492 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:36:27.179423 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:36:27.190502 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:36:27.311617 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:36:27.428901 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:36:27.551206 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:36:27.673958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:28.188594 run create_hlr_db(pid=9503): Launched 10:36:28.315628 bus /sierra_2: Setting Powered False 10:36:29.379999 run create_hlr_db(pid=9503): Terminated: ok {rc=0} 10:36:29.822815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9505): Launched 10:36:30.131622 run osmo-hlr_10.42.42.2(pid=9506): Launched 10:36:30.249158 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:30.777561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9508): Launched 10:36:31.112700 run osmo-stp_10.42.42.5(pid=9509): Launched 10:36:31.473583 tst emergency_preemptive_call.py: using MSISDN 8112 10:36:31.676243 run osmo-msc_10.42.42.6: Starting osmo-msc 10:36:32.326602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9511): Launched 10:36:32.670713 run osmo-msc_10.42.42.6(pid=9512): Launched 10:36:32.855931 run osmo-stp_10.42.42.5(pid=9509): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9509)] 10:36:32.995081 run osmo-stp_10.42.42.5(pid=9509): stdout: | (launched: 2022-12-13_10:36:31.052259) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:33.134758 run osmo-stp_10.42.42.5(pid=9509): stderr: | 20221213103631268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103631268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103631268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103631269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103631269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103631269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103631269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:33.271467 run osmo-stp_10.42.42.5(pid=9509): stdout: | (launched: 2022-12-13_10:36:31.052259) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:33.402445 run osmo-stp_10.42.42.5(pid=9509): stderr: | 20221213103631268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103631268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103631268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103631269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103631269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103631269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103631269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:33.558802 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9509): Process ended prematurely: osmo-stp_10.42.42.5(pid=9509) [trial-2388↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9509)] [trial-2388↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 10:36:33.568102 tst emergency_preemptive_call.py:32: Test FAILED (7.0 sec) 10:36:33.596248 run osmo-hlr_10.42.42.2(pid=9506): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9506)] 10:36:33.648075 run osmo-hlr_10.42.42.2(pid=9506): stdout: | (launched: 2022-12-13_10:36:30.073157) 10:36:33.701675 run osmo-hlr_10.42.42.2(pid=9506): stderr: | 20221213103630248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103630248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103630248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103630248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103630248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103630248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103630263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103630273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103630273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103630274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:33.775973 run osmo-msc_10.42.42.6(pid=9512): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9512)] 10:36:33.827093 run osmo-msc_10.42.42.6(pid=9512): stdout: | (launched: 2022-12-13_10:36:32.608247) 10:36:33.880082 run osmo-msc_10.42.42.6(pid=9512): stderr: | 20221213103632928 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213103632928 DLGLOBAL DEBUG validating counter group 0x7f131be9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213103632928 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213103632928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213103632928 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213103632929 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213103632931 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213103632931 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213103632931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213103632931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:36:33.933788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9505): Terminating (SIGTERM) 10:36:33.976531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9508): Terminating (SIGTERM) 10:36:34.019934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9511): Terminating (SIGTERM) 10:36:34.063234 --- ParallelTerminationStrategy: PID 9505 died... 10:36:34.084051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9505): Terminated: ok {rc=0} 10:36:34.131552 --- ParallelTerminationStrategy: PID 9508 died... 10:36:34.151843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9508): Terminated: ok {rc=0} 10:36:34.199259 --- ParallelTerminationStrategy: PID 9511 died... 10:36:34.219621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9511): Terminated: ok {rc=0} 10:36:34.310022 bus /sierra_9: Setting Powered False 10:36:35.412332 bus /sierra_9: Setting Powered False 10:36:36.530711 bus /sierra_8: Setting Powered False 10:36:37.628144 bus /sierra_8: Setting Powered False 10:36:38.743870 bus /sierra_3: Setting Powered False 10:36:39.844855 bus /sierra_3: Setting Powered False 10:36:40.963589 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 10:36:42.245024 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:36:42.249412 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:36:42.282699 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 10:36:42.320722 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 10:36:42.406875 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:36:42.440248 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 10:36:42.478258 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 10:36:43.068748 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 10:36:43.120020 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:43.130957 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:36:43.178824 tst cs_paging_gprs_active.py: using LAC 33358 10:36:43.302189 tst cs_paging_gprs_active.py: using RAC 208 10:36:43.422972 tst cs_paging_gprs_active.py: using CellId 33358 10:36:43.548772 tst cs_paging_gprs_active.py: using BVCI 33359 10:36:43.662831 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:43.673800 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:43.684358 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:43.695714 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:43.707205 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:43.718774 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:43.730976 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:43.741519 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:43.752077 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:36:43.875738 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:36:43.995778 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:36:44.205942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:44.521322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9517): Launched 10:36:44.796605 run iperf3-srv_10.42.42.10(pid=9518): Launched 10:36:44.915283 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:36:45.124307 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:45.440798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9519): Launched 10:36:45.715858 run iperf3-srv_10.42.42.10(pid=9520): Launched 10:36:45.833937 tst cs_paging_gprs_active.py:38: start network... 10:36:46.094627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:46.631634 run create_hlr_db(pid=9521): Launched 10:36:46.799969 bus /sierra_2: Setting Powered False 10:36:47.865574 run create_hlr_db(pid=9521): Terminated: ok {rc=0} 10:36:48.316067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9523): Launched 10:36:48.630753 run osmo-hlr_10.42.42.2(pid=9524): Launched 10:36:48.749645 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:49.299197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9526): Launched 10:36:49.614509 run osmo-stp_10.42.42.5(pid=9527): Launched 10:36:49.732077 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:36:50.271306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9529): Launched 10:36:50.390491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:36:50.656242 run patchelf(pid=9530): Launched 10:36:50.830873 run osmo-stp_10.42.42.5(pid=9527): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9527)] 10:36:50.962572 run osmo-stp_10.42.42.5(pid=9527): stdout: | (launched: 2022-12-13_10:36:49.555036) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:51.095799 run osmo-stp_10.42.42.5(pid=9527): stderr: | 20221213103649729 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103649730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103649730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103649730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103649731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103649731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103649731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:51.229681 run osmo-stp_10.42.42.5(pid=9527): stdout: | (launched: 2022-12-13_10:36:49.555036) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:51.357126 run osmo-stp_10.42.42.5(pid=9527): stderr: | 20221213103649729 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103649730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103649730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103649730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103649731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103649731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103649731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:51.507768 run patchelf(pid=9530): Terminating (SIGINT) 10:36:51.683295 run patchelf(pid=9530): Terminated: ok {rc=0} 10:36:51.809883 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9527): Process ended prematurely: osmo-stp_10.42.42.5(pid=9527) [trial-2388↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9527)] [trial-2388↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 10:36:51.819467 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:36:51.846833 run osmo-hlr_10.42.42.2(pid=9524): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9524)] 10:36:51.894828 run osmo-hlr_10.42.42.2(pid=9524): stdout: | (launched: 2022-12-13_10:36:48.571394) 10:36:51.944608 run osmo-hlr_10.42.42.2(pid=9524): stderr: | 20221213103648752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103648752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103648752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103648752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103648752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103648752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103648762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103648771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103648771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103648771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:51.994627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9517): Terminating (SIGTERM) 10:36:52.034585 run iperf3-srv_10.42.42.10(pid=9518): Terminating (SIGTERM) 10:36:52.074473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9519): Terminating (SIGTERM) 10:36:52.114596 run iperf3-srv_10.42.42.10(pid=9520): Terminating (SIGTERM) 10:36:52.154511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9523): Terminating (SIGTERM) 10:36:52.194438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9526): Terminating (SIGTERM) 10:36:52.234338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9529): Terminating (SIGTERM) 10:36:52.274458 --- ParallelTerminationStrategy: PID 9517 died... 10:36:52.293712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9517): Terminated: ok {rc=0} 10:36:52.338287 --- ParallelTerminationStrategy: PID 9518 died... 10:36:52.357002 run iperf3-srv_10.42.42.10(pid=9518): Terminated {rc=256} 10:36:52.401370 --- ParallelTerminationStrategy: PID 9519 died... 10:36:52.420178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9519): Terminated: ok {rc=0} 10:36:52.464359 --- ParallelTerminationStrategy: PID 9520 died... 10:36:52.483136 run iperf3-srv_10.42.42.10(pid=9520): Terminated {rc=256} 10:36:52.527261 --- ParallelTerminationStrategy: PID 9523 died... 10:36:52.545927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9523): Terminated: ok {rc=0} 10:36:52.589966 --- ParallelTerminationStrategy: PID 9526 died... 10:36:52.608626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9526): Terminated: ok {rc=0} 10:36:52.652662 --- ParallelTerminationStrategy: PID 9529 died... 10:36:52.671497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9529): Terminated: ok {rc=0} 10:36:52.757970 bus /gobi_0: Setting Powered False 10:36:53.859635 bus /gobi_0: Setting Powered False 10:36:54.973370 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 10:36:56.119446 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:56.131030 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:36:56.182707 tst iperf3.py: using LAC 33359 10:36:56.306293 tst iperf3.py: using RAC 209 10:36:56.430025 tst iperf3.py: using CellId 33359 10:36:56.558162 tst iperf3.py: using BVCI 33360 10:36:56.672545 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:56.683615 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:56.694497 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:56.705223 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:56.716013 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:56.726939 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:56.737880 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:56.748513 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:36:56.759442 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:36:56.877210 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:36:57.087077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:57.404822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9531): Launched 10:36:57.681745 run iperf3-srv_10.42.42.10(pid=9532): Launched 10:36:57.799062 tst iperf3.py:8: start network... 10:36:58.009070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:58.496705 run create_hlr_db(pid=9533): Launched 10:36:58.626383 bus /gobi_6: Setting Powered False 10:36:59.688839 run create_hlr_db(pid=9533): Terminated: ok {rc=0} 10:37:00.148729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9535): Launched 10:37:00.487175 run osmo-hlr_10.42.42.2(pid=9536): Launched 10:37:00.615831 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:01.217386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9538): Launched 10:37:01.568708 run osmo-stp_10.42.42.5(pid=9539): Launched 10:37:01.829898 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:02.387622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9541): Launched 10:37:02.518291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:02.803474 run patchelf(pid=9542): Launched 10:37:02.989384 run osmo-stp_10.42.42.5(pid=9539): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9539)] 10:37:03.130624 run osmo-stp_10.42.42.5(pid=9539): stdout: | (launched: 2022-12-13_10:37:01.505383) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:03.273458 run osmo-stp_10.42.42.5(pid=9539): stderr: | 20221213103701702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103701702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103701702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103701703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103701703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103701703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103701703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:03.416626 run osmo-stp_10.42.42.5(pid=9539): stdout: | (launched: 2022-12-13_10:37:01.505383) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:03.553387 run osmo-stp_10.42.42.5(pid=9539): stderr: | 20221213103701702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103701702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103701702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103701703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103701703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103701703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103701703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:03.715393 run patchelf(pid=9542): Terminating (SIGINT) 10:37:03.903428 run patchelf(pid=9542): Terminated: ok {rc=0} 10:37:04.038934 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9539): Process ended prematurely: osmo-stp_10.42.42.5(pid=9539) [trial-2388↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9539)] [trial-2388↪gprs:trx-sysmocell5000↪iperf3.py:8] 10:37:04.049337 tst iperf3.py:8: Test FAILED (8.0 sec) 10:37:04.078026 run osmo-hlr_10.42.42.2(pid=9536): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9536)] 10:37:04.129394 run osmo-hlr_10.42.42.2(pid=9536): stdout: | (launched: 2022-12-13_10:37:00.423991) 10:37:04.183318 run osmo-hlr_10.42.42.2(pid=9536): stderr: | 20221213103700622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103700622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103700623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103700623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103700623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103700623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103700635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103700643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103700643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103700643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:04.239158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9531): Terminating (SIGTERM) 10:37:04.282901 run iperf3-srv_10.42.42.10(pid=9532): Terminating (SIGTERM) 10:37:04.325752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9535): Terminating (SIGTERM) 10:37:04.368269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9538): Terminating (SIGTERM) 10:37:04.411117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9541): Terminating (SIGTERM) 10:37:04.454370 --- ParallelTerminationStrategy: PID 9531 died... 10:37:04.474874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9531): Terminated: ok {rc=0} 10:37:04.521774 --- ParallelTerminationStrategy: PID 9532 died... 10:37:04.541704 run iperf3-srv_10.42.42.10(pid=9532): Terminated {rc=256} 10:37:04.588191 --- ParallelTerminationStrategy: PID 9535 died... 10:37:04.608157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9535): Terminated: ok {rc=0} 10:37:04.654909 --- ParallelTerminationStrategy: PID 9538 died... 10:37:04.674923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9538): Terminated: ok {rc=0} 10:37:04.721813 --- ParallelTerminationStrategy: PID 9541 died... 10:37:04.741724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9541): Terminated: ok {rc=0} 10:37:04.831670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 10:37:05.983745 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:05.996653 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:37:06.049456 tst iperf3m4.py: using LAC 33360 10:37:06.181690 tst iperf3m4.py: using RAC 210 10:37:06.313345 tst iperf3m4.py: using CellId 33360 10:37:06.444857 tst iperf3m4.py: using BVCI 33361 10:37:06.568148 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:06.579504 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:06.590644 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:06.601878 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:06.613706 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:06.625529 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:06.637598 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:06.649393 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:06.661523 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:37:06.785085 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:37:06.910727 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:37:07.033754 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:37:07.152528 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:37:07.364003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:07.680301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9543): Launched 10:37:07.956320 run iperf3-srv_10.42.42.10(pid=9544): Launched 10:37:08.074842 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:37:08.284444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:08.600078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9545): Launched 10:37:08.875117 run iperf3-srv_10.42.42.10(pid=9546): Launched 10:37:08.993468 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:37:09.201638 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:09.517484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9547): Launched 10:37:09.789915 run iperf3-srv_10.42.42.10(pid=9548): Launched 10:37:09.908105 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:37:10.115847 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:10.430638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9549): Launched 10:37:10.705252 run iperf3-srv_10.42.42.10(pid=9550): Launched 10:37:10.822341 tst iperf3m4.py:8: start network... 10:37:11.030441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:11.516279 run create_hlr_db(pid=9551): Launched 10:37:11.644332 bus /gobi_6: Setting Powered False 10:37:12.706678 run create_hlr_db(pid=9551): Terminated: ok {rc=0} 10:37:13.165232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9553): Launched 10:37:13.503974 run osmo-hlr_10.42.42.2(pid=9554): Launched 10:37:13.632204 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:14.218650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9556): Launched 10:37:14.557329 run osmo-stp_10.42.42.5(pid=9557): Launched 10:37:14.687192 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:15.267410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9559): Launched 10:37:15.396556 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:15.682538 run patchelf(pid=9560): Launched 10:37:15.876938 run osmo-stp_10.42.42.5(pid=9557): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9557)] 10:37:16.041566 run osmo-stp_10.42.42.5(pid=9557): stdout: | (launched: 2022-12-13_10:37:14.493965) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:16.201007 run osmo-stp_10.42.42.5(pid=9557): stderr: | 20221213103714685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103714685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103714686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103714686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103714686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103714687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103714687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:16.347741 run osmo-stp_10.42.42.5(pid=9557): stdout: | (launched: 2022-12-13_10:37:14.493965) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:16.488413 run osmo-stp_10.42.42.5(pid=9557): stderr: | 20221213103714685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103714685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103714686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103714686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103714686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103714687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103714687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:16.683694 run patchelf(pid=9560): Terminating (SIGINT) 10:37:16.926396 run patchelf(pid=9560): Terminated: ok {rc=0} 10:37:17.091010 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9557): Process ended prematurely: osmo-stp_10.42.42.5(pid=9557) [trial-2388↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9557)] [trial-2388↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 10:37:17.102548 tst iperf3m4.py:8: Test FAILED (11.2 sec) 10:37:17.132897 run osmo-hlr_10.42.42.2(pid=9554): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9554)] 10:37:17.188860 run osmo-hlr_10.42.42.2(pid=9554): stdout: | (launched: 2022-12-13_10:37:13.440810) 10:37:17.244076 run osmo-hlr_10.42.42.2(pid=9554): stderr: | 20221213103713637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103713637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103713637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103713637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103713637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103713637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103713650 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103713660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103713661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103713661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:17.300064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9543): Terminating (SIGTERM) 10:37:17.344267 run iperf3-srv_10.42.42.10(pid=9544): Terminating (SIGTERM) 10:37:17.389707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9545): Terminating (SIGTERM) 10:37:17.433695 run iperf3-srv_10.42.42.10(pid=9546): Terminating (SIGTERM) 10:37:17.476335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9547): Terminating (SIGTERM) 10:37:17.519426 run iperf3-srv_10.42.42.10(pid=9548): Terminating (SIGTERM) 10:37:17.562172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9549): Terminating (SIGTERM) 10:37:17.604936 run iperf3-srv_10.42.42.10(pid=9550): Terminating (SIGTERM) 10:37:17.647634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9553): Terminating (SIGTERM) 10:37:17.690528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9556): Terminating (SIGTERM) 10:37:17.733224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9559): Terminating (SIGTERM) 10:37:17.776481 --- ParallelTerminationStrategy: PID 9543 died... 10:37:17.797235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9543): Terminated: ok {rc=0} 10:37:17.845128 --- ParallelTerminationStrategy: PID 9544 died... 10:37:17.865518 run iperf3-srv_10.42.42.10(pid=9544): Terminated {rc=256} 10:37:17.913064 --- ParallelTerminationStrategy: PID 9545 died... 10:37:17.933473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9545): Terminated: ok {rc=0} 10:37:17.980824 --- ParallelTerminationStrategy: PID 9546 died... 10:37:18.001555 run iperf3-srv_10.42.42.10(pid=9546): Terminated {rc=256} 10:37:18.048934 --- ParallelTerminationStrategy: PID 9547 died... 10:37:18.069778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9547): Terminated: ok {rc=0} 10:37:18.117325 --- ParallelTerminationStrategy: PID 9548 died... 10:37:18.137512 run iperf3-srv_10.42.42.10(pid=9548): Terminated {rc=256} 10:37:18.184826 --- ParallelTerminationStrategy: PID 9549 died... 10:37:18.205744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9549): Terminated: ok {rc=0} 10:37:18.253229 --- ParallelTerminationStrategy: PID 9550 died... 10:37:18.273567 run iperf3-srv_10.42.42.10(pid=9550): Terminated {rc=256} 10:37:18.321079 --- ParallelTerminationStrategy: PID 9553 died... 10:37:18.341575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9553): Terminated: ok {rc=0} 10:37:18.389307 --- ParallelTerminationStrategy: PID 9556 died... 10:37:18.409783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9556): Terminated: ok {rc=0} 10:37:18.457447 --- ParallelTerminationStrategy: PID 9559 died... 10:37:18.477924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9559): Terminated: ok {rc=0} 10:37:18.568148 bus /gobi_4: Setting Powered False 10:37:19.669164 bus /gobi_4: Setting Powered False 10:37:20.786418 bus /gobi_1: Setting Powered False 10:37:21.886297 bus /gobi_1: Setting Powered False 10:37:23.005939 bus /gobi_0: Setting Powered False 10:37:24.105778 bus /gobi_0: Setting Powered False 10:37:25.223524 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 10:37:26.328096 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:26.339839 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:37:26.390661 tst ping.py: using LAC 33361 10:37:26.512386 tst ping.py: using RAC 211 10:37:26.634909 tst ping.py: using CellId 33361 10:37:26.756615 tst ping.py: using BVCI 33362 10:37:26.869111 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:26.879852 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:26.890577 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:26.901371 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:26.911914 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:26.922476 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:26.933193 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:26.943896 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:37:27.060275 tst ping.py:19: start network... 10:37:27.282429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:27.792812 run create_hlr_db(pid=9561): Launched 10:37:27.919417 bus /gobi_6: Setting Powered False 10:37:28.983274 run create_hlr_db(pid=9561): Terminated: ok {rc=0} 10:37:29.442226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9563): Launched 10:37:29.773586 run osmo-hlr_10.42.42.2(pid=9564): Launched 10:37:29.900613 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:30.472157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9566): Launched 10:37:30.805634 run osmo-stp_10.42.42.5(pid=9567): Launched 10:37:30.941592 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:31.692594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9569): Launched 10:37:31.850373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:32.173695 run patchelf(pid=9570): Launched 10:37:32.365706 run osmo-stp_10.42.42.5(pid=9567): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9567)] 10:37:32.506212 run osmo-stp_10.42.42.5(pid=9567): stdout: | (launched: 2022-12-13_10:37:30.743309) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:32.647892 run osmo-stp_10.42.42.5(pid=9567): stderr: | 20221213103731057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103731057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103731058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103731058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103731059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103731059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103731059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:32.789123 run osmo-stp_10.42.42.5(pid=9567): stdout: | (launched: 2022-12-13_10:37:30.743309) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:32.924755 run osmo-stp_10.42.42.5(pid=9567): stderr: | 20221213103731057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103731057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103731058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103731058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103731059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103731059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103731059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:33.085016 run patchelf(pid=9570): Terminating (SIGINT) 10:37:33.269661 run patchelf(pid=9570): Terminated: ok {rc=0} 10:37:33.403253 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9567): Process ended prematurely: osmo-stp_10.42.42.5(pid=9567) [trial-2388↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9567)] [trial-2388↪gprs:trx-sysmocell5000↪ping.py:22] 10:37:33.413062 tst ping.py:22: Test FAILED (7.1 sec) 10:37:33.441798 run osmo-hlr_10.42.42.2(pid=9564): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9564)] 10:37:33.493769 run osmo-hlr_10.42.42.2(pid=9564): stdout: | (launched: 2022-12-13_10:37:29.711530) 10:37:33.547800 run osmo-hlr_10.42.42.2(pid=9564): stderr: | 20221213103729909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103729909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103729909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103729910 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103729910 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103729910 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103729922 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103729931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103729931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103729931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:33.602049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9563): Terminating (SIGTERM) 10:37:33.645462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9566): Terminating (SIGTERM) 10:37:33.688757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9569): Terminating (SIGTERM) 10:37:33.732510 --- ParallelTerminationStrategy: PID 9563 died... 10:37:33.753591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9563): Terminated: ok {rc=0} 10:37:33.801507 --- ParallelTerminationStrategy: PID 9566 died... 10:37:33.822521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9566): Terminated: ok {rc=0} 10:37:33.870444 --- ParallelTerminationStrategy: PID 9569 died... 10:37:33.890848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9569): Terminated: ok {rc=0} 10:37:33.982127 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 10:37:35.072308 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:35.084575 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:37:35.136913 tst ping_idle_ping.py: using LAC 33362 10:37:35.267080 tst ping_idle_ping.py: using RAC 212 10:37:35.394582 tst ping_idle_ping.py: using CellId 33362 10:37:35.526280 tst ping_idle_ping.py: using BVCI 33363 10:37:35.640586 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:35.651672 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:35.662596 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:35.673864 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:35.684461 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:35.695194 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:35.706262 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:37:35.717106 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:37:35.837751 tst ping_idle_ping.py:24: start network... 10:37:36.061324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:36.551437 run create_hlr_db(pid=9571): Launched 10:37:36.677926 bus /gobi_6: Setting Powered False 10:37:37.740191 run create_hlr_db(pid=9571): Terminated: ok {rc=0} 10:37:38.172893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Launched 10:37:38.484068 run osmo-hlr_10.42.42.2(pid=9574): Launched 10:37:38.602644 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:39.136816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Launched 10:37:39.446451 run osmo-stp_10.42.42.5(pid=9577): Launched 10:37:39.563665 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:40.094455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9579): Launched 10:37:40.211216 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:40.472041 run patchelf(pid=9580): Launched 10:37:40.643534 run osmo-stp_10.42.42.5(pid=9577): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] 10:37:40.773524 run osmo-stp_10.42.42.5(pid=9577): stdout: | (launched: 2022-12-13_10:37:39.387778) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:40.905172 run osmo-stp_10.42.42.5(pid=9577): stderr: | 20221213103739559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103739560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103739560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103739560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103739561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103739561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103739561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:41.036906 run osmo-stp_10.42.42.5(pid=9577): stdout: | (launched: 2022-12-13_10:37:39.387778) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:41.162996 run osmo-stp_10.42.42.5(pid=9577): stderr: | 20221213103739559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103739560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103739560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103739560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103739561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103739561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103739561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:41.311850 run patchelf(pid=9580): Terminating (SIGINT) 10:37:41.484215 run patchelf(pid=9580): Terminated: ok {rc=0} 10:37:41.609691 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9577): Process ended prematurely: osmo-stp_10.42.42.5(pid=9577) [trial-2388↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] [trial-2388↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 10:37:41.618721 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:37:41.645688 run osmo-hlr_10.42.42.2(pid=9574): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9574)] 10:37:41.694123 run osmo-hlr_10.42.42.2(pid=9574): stdout: | (launched: 2022-12-13_10:37:38.425175) 10:37:41.744135 run osmo-hlr_10.42.42.2(pid=9574): stderr: | 20221213103738602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103738602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103738602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103738602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103738602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103738602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103738613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103738621 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103738622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103738622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:41.794921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Terminating (SIGTERM) 10:37:41.835536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Terminating (SIGTERM) 10:37:41.875998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9579): Terminating (SIGTERM) 10:37:41.917077 --- ParallelTerminationStrategy: PID 9573 died... 10:37:41.936632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Terminated: ok {rc=0} 10:37:41.981386 --- ParallelTerminationStrategy: PID 9576 died... 10:37:42.000433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Terminated: ok {rc=0} 10:37:42.045117 --- ParallelTerminationStrategy: PID 9579 died... 10:37:42.064049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9579): Terminated: ok {rc=0} 10:37:42.148452 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 10:37:43.453853 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:37:43.459189 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:37:43.492275 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:37:43.530577 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:37:43.616556 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:37:43.650011 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:37:43.687799 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:37:44.282216 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:37:44.332219 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:44.343168 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:37:44.393659 tst cs_paging_gprs_active.py: using LAC 33363 10:37:44.516777 tst cs_paging_gprs_active.py: using RAC 213 10:37:44.640775 tst cs_paging_gprs_active.py: using CellId 33363 10:37:44.764825 tst cs_paging_gprs_active.py: using BVCI 33364 10:37:44.879646 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:44.890686 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:44.901438 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:44.912195 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:44.923003 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:44.933879 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:44.945208 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:44.955752 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:44.966785 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:37:45.089199 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:37:45.212191 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:37:45.439394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:45.779414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9587): Launched 10:37:46.087076 run iperf3-srv_10.42.42.10(pid=9588): Launched 10:37:46.216716 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:37:46.439155 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:46.771230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9589): Launched 10:37:47.057677 run iperf3-srv_10.42.42.10(pid=9590): Launched 10:37:47.195419 tst cs_paging_gprs_active.py:38: start network... 10:37:47.425536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:47.950629 run create_hlr_db(pid=9591): Launched 10:37:48.080555 bus /gobi_6: Setting Powered False 10:37:49.146495 run create_hlr_db(pid=9591): Terminated: ok {rc=0} 10:37:49.596117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9593): Launched 10:37:49.914224 run osmo-hlr_10.42.42.2(pid=9594): Launched 10:37:50.033181 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:50.586280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9596): Launched 10:37:50.900737 run osmo-stp_10.42.42.5(pid=9597): Launched 10:37:51.020919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:51.560062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9599): Launched 10:37:51.681942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:51.948325 run patchelf(pid=9600): Launched 10:37:52.122177 run osmo-stp_10.42.42.5(pid=9597): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9597)] 10:37:52.253904 run osmo-stp_10.42.42.5(pid=9597): stdout: | (launched: 2022-12-13_10:37:50.841110) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:52.387007 run osmo-stp_10.42.42.5(pid=9597): stderr: | 20221213103751012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103751012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103751012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103751013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103751013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103751013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103751013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:52.520365 run osmo-stp_10.42.42.5(pid=9597): stdout: | (launched: 2022-12-13_10:37:50.841110) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:52.648279 run osmo-stp_10.42.42.5(pid=9597): stderr: | 20221213103751012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103751012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103751012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103751013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103751013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103751013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103751013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:52.799406 run patchelf(pid=9600): Terminating (SIGINT) 10:37:52.975067 run patchelf(pid=9600): Terminated: ok {rc=0} 10:37:53.101880 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9597): Process ended prematurely: osmo-stp_10.42.42.5(pid=9597) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9597)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:37:53.111355 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:37:53.138824 run osmo-hlr_10.42.42.2(pid=9594): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9594)] 10:37:53.187454 run osmo-hlr_10.42.42.2(pid=9594): stdout: | (launched: 2022-12-13_10:37:49.854798) 10:37:53.237810 run osmo-hlr_10.42.42.2(pid=9594): stderr: | 20221213103750030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103750030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103750030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103750030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103750030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103750030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103750044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103750054 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103750054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103750054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:53.288775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9587): Terminating (SIGTERM) 10:37:53.329321 run iperf3-srv_10.42.42.10(pid=9588): Terminating (SIGTERM) 10:37:53.369657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9589): Terminating (SIGTERM) 10:37:53.410052 run iperf3-srv_10.42.42.10(pid=9590): Terminating (SIGTERM) 10:37:53.450167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9593): Terminating (SIGTERM) 10:37:53.490466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9596): Terminating (SIGTERM) 10:37:53.530652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9599): Terminating (SIGTERM) 10:37:53.571225 --- ParallelTerminationStrategy: PID 9587 died... 10:37:53.590561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9587): Terminated: ok {rc=0} 10:37:53.635281 --- ParallelTerminationStrategy: PID 9588 died... 10:37:53.653992 run iperf3-srv_10.42.42.10(pid=9588): Terminated {rc=256} 10:37:53.699531 --- ParallelTerminationStrategy: PID 9589 died... 10:37:53.718414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9589): Terminated: ok {rc=0} 10:37:53.762712 --- ParallelTerminationStrategy: PID 9590 died... 10:37:53.781480 run iperf3-srv_10.42.42.10(pid=9590): Terminated {rc=256} 10:37:53.825775 --- ParallelTerminationStrategy: PID 9593 died... 10:37:53.844428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9593): Terminated: ok {rc=0} 10:37:53.888538 --- ParallelTerminationStrategy: PID 9596 died... 10:37:53.907398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9596): Terminated: ok {rc=0} 10:37:53.951768 --- ParallelTerminationStrategy: PID 9599 died... 10:37:53.970593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9599): Terminated: ok {rc=0} 10:37:54.058106 bus /gobi_0: Setting Powered False 10:37:55.160863 bus /gobi_0: Setting Powered False 10:37:56.278637 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:37:57.431233 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:57.443440 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:37:57.500740 tst iperf3.py: using LAC 33364 10:37:57.631164 tst iperf3.py: using RAC 214 10:37:57.761047 tst iperf3.py: using CellId 33364 10:37:57.890875 tst iperf3.py: using BVCI 33365 10:37:58.011681 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:58.023294 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:58.034637 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:58.045944 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:58.057488 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:58.068886 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:58.080686 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:58.092137 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:58.103823 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:37:58.222136 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:37:58.427760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:58.738703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9601): Launched 10:37:59.012391 run iperf3-srv_10.42.42.10(pid=9602): Launched 10:37:59.130605 tst iperf3.py:8: start network... 10:37:59.339864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:59.824752 run create_hlr_db(pid=9603): Launched 10:37:59.954073 bus /gobi_6: Setting Powered False 10:38:01.022326 run create_hlr_db(pid=9603): Terminated: ok {rc=0} 10:38:01.465302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9605): Launched 10:38:01.828198 run osmo-hlr_10.42.42.2(pid=9606): Launched 10:38:01.975667 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:02.616213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9608): Launched 10:38:02.932036 run osmo-stp_10.42.42.5(pid=9609): Launched 10:38:03.051615 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:38:03.588651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9611): Launched 10:38:03.709375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:38:03.975083 run patchelf(pid=9612): Launched 10:38:04.148155 run osmo-stp_10.42.42.5(pid=9609): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9609)] 10:38:04.279417 run osmo-stp_10.42.42.5(pid=9609): stdout: | (launched: 2022-12-13_10:38:02.872329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:04.411821 run osmo-stp_10.42.42.5(pid=9609): stderr: | 20221213103803042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103803043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103803043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103803043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103803044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103803044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103803044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:04.544836 run osmo-stp_10.42.42.5(pid=9609): stdout: | (launched: 2022-12-13_10:38:02.872329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:04.671649 run osmo-stp_10.42.42.5(pid=9609): stderr: | 20221213103803042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103803043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103803043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103803043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103803044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103803044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103803044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:04.822682 run patchelf(pid=9612): Terminating (SIGINT) 10:38:04.996693 run patchelf(pid=9612): Terminated: ok {rc=0} 10:38:05.122504 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9609): Process ended prematurely: osmo-stp_10.42.42.5(pid=9609) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9609)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 10:38:05.131928 tst iperf3.py:8: Test FAILED (7.7 sec) 10:38:05.159042 run osmo-hlr_10.42.42.2(pid=9606): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9606)] 10:38:05.206729 run osmo-hlr_10.42.42.2(pid=9606): stdout: | (launched: 2022-12-13_10:38:01.764710) 10:38:05.256087 run osmo-hlr_10.42.42.2(pid=9606): stderr: | 20221213103802128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103802129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103802129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103802129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103802129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103802129 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103802153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103802174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103802174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103802174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:05.305809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9601): Terminating (SIGTERM) 10:38:05.345931 run iperf3-srv_10.42.42.10(pid=9602): Terminating (SIGTERM) 10:38:05.385823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9605): Terminating (SIGTERM) 10:38:05.425798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9608): Terminating (SIGTERM) 10:38:05.465636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9611): Terminating (SIGTERM) 10:38:05.505766 --- ParallelTerminationStrategy: PID 9601 died... 10:38:05.525043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9601): Terminated: ok {rc=0} 10:38:05.568858 --- ParallelTerminationStrategy: PID 9602 died... 10:38:05.587930 run iperf3-srv_10.42.42.10(pid=9602): Terminated {rc=256} 10:38:05.648267 --- ParallelTerminationStrategy: PID 9605 died... 10:38:05.668521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9605): Terminated: ok {rc=0} 10:38:05.715998 --- ParallelTerminationStrategy: PID 9608 died... 10:38:05.736543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9608): Terminated: ok {rc=0} 10:38:05.783438 --- ParallelTerminationStrategy: PID 9611 died... 10:38:05.804043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9611): Terminated: ok {rc=0} 10:38:05.894350 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:38:07.045365 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:07.057379 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:38:07.109879 tst iperf3m4.py: using LAC 33365 10:38:07.239408 tst iperf3m4.py: using RAC 215 10:38:07.369656 tst iperf3m4.py: using CellId 33365 10:38:07.491707 tst iperf3m4.py: using BVCI 33366 10:38:07.603794 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:07.615090 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:07.626145 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:07.637057 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:07.647834 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:07.659144 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:07.670054 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:07.680605 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:07.691446 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:38:07.813054 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:38:07.934816 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:38:08.055913 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:38:08.174371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:38:08.381244 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:08.691888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9613): Launched 10:38:08.961448 run iperf3-srv_10.42.42.10(pid=9614): Launched 10:38:09.078636 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:38:09.284388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:09.593990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9615): Launched 10:38:09.865475 run iperf3-srv_10.42.42.10(pid=9616): Launched 10:38:09.980234 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:38:10.184896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:10.494463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9617): Launched 10:38:10.762170 run iperf3-srv_10.42.42.10(pid=9618): Launched 10:38:10.876686 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:38:11.081958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:11.390963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9619): Launched 10:38:11.660445 run iperf3-srv_10.42.42.10(pid=9620): Launched 10:38:11.777521 tst iperf3m4.py:8: start network... 10:38:11.983923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:12.459970 run create_hlr_db(pid=9621): Launched 10:38:12.586055 bus /gobi_6: Setting Powered False 10:38:13.647237 run create_hlr_db(pid=9621): Terminated: ok {rc=0} 10:38:14.076905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9623): Launched 10:38:14.386101 run osmo-hlr_10.42.42.2(pid=9624): Launched 10:38:14.501582 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:15.030699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9626): Launched 10:38:15.340254 run osmo-stp_10.42.42.5(pid=9627): Launched 10:38:15.458582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:38:16.021128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9629): Launched 10:38:16.193265 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:38:16.468878 run patchelf(pid=9630): Launched 10:38:16.659292 run osmo-stp_10.42.42.5(pid=9627): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9627)] 10:38:16.793755 run osmo-stp_10.42.42.5(pid=9627): stdout: | (launched: 2022-12-13_10:38:15.282030) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:16.930102 run osmo-stp_10.42.42.5(pid=9627): stderr: | 20221213103815452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103815452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103815453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103815453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103815453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103815453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103815454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:17.065899 run osmo-stp_10.42.42.5(pid=9627): stdout: | (launched: 2022-12-13_10:38:15.282030) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:17.196510 run osmo-stp_10.42.42.5(pid=9627): stderr: | 20221213103815452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103815452 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103815453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103815453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103815453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103815453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103815454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:17.347403 run patchelf(pid=9630): Terminating (SIGINT) 10:38:17.520331 run patchelf(pid=9630): Terminated: ok {rc=0} 10:38:17.644925 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9627): Process ended prematurely: osmo-stp_10.42.42.5(pid=9627) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9627)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 10:38:17.654858 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:38:17.682794 run osmo-hlr_10.42.42.2(pid=9624): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9624)] 10:38:17.731578 run osmo-hlr_10.42.42.2(pid=9624): stdout: | (launched: 2022-12-13_10:38:14.327413) 10:38:17.782153 run osmo-hlr_10.42.42.2(pid=9624): stderr: | 20221213103814504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103814504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103814504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103814504 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103814504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103814504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103814516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103814526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103814526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103814526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:17.833180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9613): Terminating (SIGTERM) 10:38:17.874361 run iperf3-srv_10.42.42.10(pid=9614): Terminating (SIGTERM) 10:38:17.915442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9615): Terminating (SIGTERM) 10:38:17.955903 run iperf3-srv_10.42.42.10(pid=9616): Terminating (SIGTERM) 10:38:17.996035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9617): Terminating (SIGTERM) 10:38:18.036363 run iperf3-srv_10.42.42.10(pid=9618): Terminating (SIGTERM) 10:38:18.076452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9619): Terminating (SIGTERM) 10:38:18.116831 run iperf3-srv_10.42.42.10(pid=9620): Terminating (SIGTERM) 10:38:18.157321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9623): Terminating (SIGTERM) 10:38:18.197790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9626): Terminating (SIGTERM) 10:38:18.238176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9629): Terminating (SIGTERM) 10:38:18.278875 --- ParallelTerminationStrategy: PID 9613 died... 10:38:18.298410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9613): Terminated: ok {rc=0} 10:38:18.343419 --- ParallelTerminationStrategy: PID 9614 died... 10:38:18.362892 run iperf3-srv_10.42.42.10(pid=9614): Terminated {rc=256} 10:38:18.407478 --- ParallelTerminationStrategy: PID 9615 died... 10:38:18.426483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9615): Terminated: ok {rc=0} 10:38:18.471145 --- ParallelTerminationStrategy: PID 9616 died... 10:38:18.490136 run iperf3-srv_10.42.42.10(pid=9616): Terminated {rc=256} 10:38:18.534906 --- ParallelTerminationStrategy: PID 9617 died... 10:38:18.554088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9617): Terminated: ok {rc=0} 10:38:18.598903 --- ParallelTerminationStrategy: PID 9618 died... 10:38:18.617775 run iperf3-srv_10.42.42.10(pid=9618): Terminated {rc=256} 10:38:18.662552 --- ParallelTerminationStrategy: PID 9619 died... 10:38:18.682213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9619): Terminated: ok {rc=0} 10:38:18.727030 --- ParallelTerminationStrategy: PID 9620 died... 10:38:18.746115 run iperf3-srv_10.42.42.10(pid=9620): Terminated {rc=256} 10:38:18.790791 --- ParallelTerminationStrategy: PID 9623 died... 10:38:18.809888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9623): Terminated: ok {rc=0} 10:38:18.854793 --- ParallelTerminationStrategy: PID 9626 died... 10:38:18.873937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9626): Terminated: ok {rc=0} 10:38:18.918538 --- ParallelTerminationStrategy: PID 9629 died... 10:38:18.937859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9629): Terminated: ok {rc=0} 10:38:19.024855 bus /gobi_4: Setting Powered False 10:38:20.126522 bus /gobi_4: Setting Powered False 10:38:21.243827 bus /gobi_1: Setting Powered False 10:38:22.344515 bus /gobi_1: Setting Powered False 10:38:23.459750 bus /gobi_0: Setting Powered False 10:38:24.559267 bus /gobi_0: Setting Powered False 10:38:25.679274 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 10:38:26.782362 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:26.794408 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:38:26.847083 tst ping.py: using LAC 33366 10:38:26.974669 tst ping.py: using RAC 216 10:38:27.102703 tst ping.py: using CellId 33366 10:38:27.222780 tst ping.py: using BVCI 33367 10:38:27.331906 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:27.343113 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:27.354078 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:27.365013 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:27.375775 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:27.386565 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:27.397803 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:27.408472 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:38:27.529275 tst ping.py:19: start network... 10:38:27.747339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:28.250674 run create_hlr_db(pid=9631): Launched 10:38:28.375886 bus /gobi_6: Setting Powered False 10:38:29.440449 run create_hlr_db(pid=9631): Terminated: ok {rc=0} 10:38:29.874298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9633): Launched 10:38:30.178844 run osmo-hlr_10.42.42.2(pid=9634): Launched 10:38:30.294652 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:30.817181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9636): Launched 10:38:31.132819 run osmo-stp_10.42.42.5(pid=9637): Launched 10:38:31.256252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:38:32.064091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9639): Launched 10:38:32.196533 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:38:32.460176 run patchelf(pid=9640): Launched 10:38:32.629658 run osmo-stp_10.42.42.5(pid=9637): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9637)] 10:38:32.757072 run osmo-stp_10.42.42.5(pid=9637): stdout: | (launched: 2022-12-13_10:38:31.071845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:32.885881 run osmo-stp_10.42.42.5(pid=9637): stderr: | 20221213103831523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103831523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103831524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103831526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103831528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103831528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103831529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:33.014827 run osmo-stp_10.42.42.5(pid=9637): stdout: | (launched: 2022-12-13_10:38:31.071845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:33.138135 run osmo-stp_10.42.42.5(pid=9637): stderr: | 20221213103831523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103831523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103831524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103831526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103831528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103831528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103831529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:33.284158 run patchelf(pid=9640): Terminating (SIGINT) 10:38:33.453462 run patchelf(pid=9640): Terminated: ok {rc=0} 10:38:33.575365 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9637): Process ended prematurely: osmo-stp_10.42.42.5(pid=9637) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9637)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 10:38:33.584264 tst ping.py:22: Test FAILED (6.8 sec) 10:38:33.611198 run osmo-hlr_10.42.42.2(pid=9634): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9634)] 10:38:33.659021 run osmo-hlr_10.42.42.2(pid=9634): stdout: | (launched: 2022-12-13_10:38:30.121825) 10:38:33.708441 run osmo-hlr_10.42.42.2(pid=9634): stderr: | 20221213103830296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103830296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103830296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103830296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103830296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103830296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103830312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103830322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103830322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103830322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:33.758506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9633): Terminating (SIGTERM) 10:38:33.798291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9636): Terminating (SIGTERM) 10:38:33.838185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9639): Terminating (SIGTERM) 10:38:33.878471 --- ParallelTerminationStrategy: PID 9633 died... 10:38:33.897712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9633): Terminated: ok {rc=0} 10:38:33.941988 --- ParallelTerminationStrategy: PID 9636 died... 10:38:33.960606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9636): Terminated: ok {rc=0} 10:38:34.005494 --- ParallelTerminationStrategy: PID 9639 died... 10:38:34.024364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9639): Terminated: ok {rc=0} 10:38:34.110777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:38:35.199397 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:35.211073 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:38:35.262645 tst ping_idle_ping.py: using LAC 33367 10:38:35.386679 tst ping_idle_ping.py: using RAC 217 10:38:35.512573 tst ping_idle_ping.py: using CellId 33367 10:38:35.630732 tst ping_idle_ping.py: using BVCI 33368 10:38:35.740060 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:35.751044 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:35.761852 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:35.772581 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:35.783491 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:35.794421 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:35.805599 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:35.816464 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:38:35.936655 tst ping_idle_ping.py:24: start network... 10:38:36.156532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:36.690836 run create_hlr_db(pid=9641): Launched 10:38:36.814065 bus /gobi_6: Setting Powered False 10:38:37.878244 run create_hlr_db(pid=9641): Terminated: ok {rc=0} 10:38:38.309044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9643): Launched 10:38:38.633683 run osmo-hlr_10.42.42.2(pid=9644): Launched 10:38:38.757572 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:39.313523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9646): Launched 10:38:39.634770 run osmo-stp_10.42.42.5(pid=9647): Launched 10:38:39.757225 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:38:40.317253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9649): Launched 10:38:40.440479 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:38:40.713992 run patchelf(pid=9650): Launched 10:38:40.895448 run osmo-stp_10.42.42.5(pid=9647): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9647)] 10:38:41.032107 run osmo-stp_10.42.42.5(pid=9647): stdout: | (launched: 2022-12-13_10:38:39.575855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:41.170402 run osmo-stp_10.42.42.5(pid=9647): stderr: | 20221213103839764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103839764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103839764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103839765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103839765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103839765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103839765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:41.308194 run osmo-stp_10.42.42.5(pid=9647): stdout: | (launched: 2022-12-13_10:38:39.575855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:41.440822 run osmo-stp_10.42.42.5(pid=9647): stderr: | 20221213103839764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103839764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103839764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103839765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103839765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103839765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103839765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:41.597748 run patchelf(pid=9650): Terminating (SIGINT) 10:38:41.778745 run patchelf(pid=9650): Terminated: ok {rc=0} 10:38:41.910449 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9647): Process ended prematurely: osmo-stp_10.42.42.5(pid=9647) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9647)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 10:38:41.920058 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:38:41.947932 run osmo-hlr_10.42.42.2(pid=9644): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9644)] 10:38:41.998710 run osmo-hlr_10.42.42.2(pid=9644): stdout: | (launched: 2022-12-13_10:38:38.574446) 10:38:42.050659 run osmo-hlr_10.42.42.2(pid=9644): stderr: | 20221213103838769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103838769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103838769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103838769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103838769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103838769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103838782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103838790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103838791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103838791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:42.104018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9643): Terminating (SIGTERM) 10:38:42.146067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9646): Terminating (SIGTERM) 10:38:42.188261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9649): Terminating (SIGTERM) 10:38:42.231204 --- ParallelTerminationStrategy: PID 9643 died... 10:38:42.251807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9643): Terminated: ok {rc=0} 10:38:42.299036 --- ParallelTerminationStrategy: PID 9646 died... 10:38:42.319180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9646): Terminated: ok {rc=0} 10:38:42.366183 --- ParallelTerminationStrategy: PID 9649 died... 10:38:42.386330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9649): Terminated: ok {rc=0} 10:38:42.475560 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:38:43.789387 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:38:43.796172 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:38:43.830579 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:38:43.871226 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:38:43.959349 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:38:43.993200 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:38:44.031981 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:38:44.629538 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:38:44.682350 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:44.693718 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:38:44.770123 tst cs_paging_gprs_active.py: using LAC 33368 10:38:44.890176 tst cs_paging_gprs_active.py: using RAC 218 10:38:45.010083 tst cs_paging_gprs_active.py: using CellId 33368 10:38:45.130766 tst cs_paging_gprs_active.py: using BVCI 33369 10:38:45.242480 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:45.253390 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:45.264168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:45.274843 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:45.285486 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:45.296019 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:45.307396 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:45.318036 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:45.328762 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:38:45.445459 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:38:45.562142 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:38:45.766945 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:46.089470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9657): Launched 10:38:46.423605 run iperf3-srv_10.42.42.10(pid=9658): Launched 10:38:46.553841 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:38:46.773182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:47.117277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9683): Launched 10:38:47.433672 run iperf3-srv_10.42.42.10(pid=9696): Launched 10:38:47.657022 tst cs_paging_gprs_active.py:38: start network... 10:38:47.900069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:48.470576 run create_hlr_db(pid=9744): Launched 10:38:48.675945 bus /gobi_6: Setting Powered False 10:38:49.738036 run create_hlr_db(pid=9744): Terminated: ok {rc=0} 10:38:50.236042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9932): Launched 10:38:50.564351 run osmo-hlr_10.42.42.2(pid=9933): Launched 10:38:50.803203 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:51.514207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9937): Launched 10:38:51.856263 run osmo-stp_10.42.42.5(pid=9938): Launched 10:38:52.113391 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:38:52.749831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9940): Launched 10:38:52.888318 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:38:53.170334 run patchelf(pid=9941): Launched 10:38:53.367686 run osmo-stp_10.42.42.5(pid=9938): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9938)] 10:38:53.509361 run osmo-stp_10.42.42.5(pid=9938): stdout: | (launched: 2022-12-13_10:38:51.795159) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:53.653807 run osmo-stp_10.42.42.5(pid=9938): stderr: | 20221213103852084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103852089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103852089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103852090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103852090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103852090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103852090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:53.798366 run osmo-stp_10.42.42.5(pid=9938): stdout: | (launched: 2022-12-13_10:38:51.795159) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:53.936218 run osmo-stp_10.42.42.5(pid=9938): stderr: | 20221213103852084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103852089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103852089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103852090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103852090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103852090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103852090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:54.099393 run patchelf(pid=9941): Terminating (SIGINT) 10:38:54.288406 run patchelf(pid=9941): Terminated: ok {rc=0} 10:38:54.425571 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9938): Process ended prematurely: osmo-stp_10.42.42.5(pid=9938) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9938)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:38:54.437093 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 10:38:54.467151 run osmo-hlr_10.42.42.2(pid=9933): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9933)] 10:38:54.522160 run osmo-hlr_10.42.42.2(pid=9933): stdout: | (launched: 2022-12-13_10:38:50.504721) 10:38:54.579183 run osmo-hlr_10.42.42.2(pid=9933): stderr: | 20221213103850837 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103850837 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103850837 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103850838 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103850838 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103850838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103850859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103850871 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103850872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103850872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:54.634635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9657): Terminating (SIGTERM) 10:38:54.678798 run iperf3-srv_10.42.42.10(pid=9658): Terminating (SIGTERM) 10:38:54.726367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9683): Terminating (SIGTERM) 10:38:54.771604 run iperf3-srv_10.42.42.10(pid=9696): Terminating (SIGTERM) 10:38:54.819401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9932): Terminating (SIGTERM) 10:38:54.865585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9937): Terminating (SIGTERM) 10:38:54.912179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9940): Terminating (SIGTERM) 10:38:54.959365 --- ParallelTerminationStrategy: PID 9657 died... 10:38:54.981650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9657): Terminated: ok {rc=0} 10:38:55.033199 --- ParallelTerminationStrategy: PID 9658 died... 10:38:55.053963 run iperf3-srv_10.42.42.10(pid=9658): Terminated {rc=256} 10:38:55.102956 --- ParallelTerminationStrategy: PID 9683 died... 10:38:55.124484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9683): Terminated: ok {rc=0} 10:38:55.173489 --- ParallelTerminationStrategy: PID 9696 died... 10:38:55.195126 run iperf3-srv_10.42.42.10(pid=9696): Terminated {rc=256} 10:38:55.243873 --- ParallelTerminationStrategy: PID 9932 died... 10:38:55.266030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9932): Terminated: ok {rc=0} 10:38:55.315485 --- ParallelTerminationStrategy: PID 9937 died... 10:38:55.337104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9937): Terminated: ok {rc=0} 10:38:55.386382 --- ParallelTerminationStrategy: PID 9940 died... 10:38:55.408298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9940): Terminated: ok {rc=0} 10:38:55.501702 bus /gobi_0: Setting Powered False 10:38:56.607248 bus /gobi_0: Setting Powered False 10:38:57.731567 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:38:58.884408 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:58.897262 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:38:58.972310 tst iperf3.py: using LAC 33369 10:38:59.095113 tst iperf3.py: using RAC 219 10:38:59.220695 tst iperf3.py: using CellId 33369 10:38:59.345892 tst iperf3.py: using BVCI 33370 10:38:59.462034 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:59.474141 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:59.486177 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:59.498218 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:59.510196 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:59.523308 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:59.537282 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:59.549255 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:59.561657 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:38:59.680861 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:38:59.892236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:00.208334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9942): Launched 10:39:00.496643 run iperf3-srv_10.42.42.10(pid=9943): Launched 10:39:00.631136 tst iperf3.py:8: start network... 10:39:00.844343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:01.384744 run create_hlr_db(pid=9944): Launched 10:39:01.578288 bus /gobi_6: Setting Powered False 10:39:02.656092 run create_hlr_db(pid=9944): Terminated: ok {rc=0} 10:39:03.162700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9946): Launched 10:39:03.509164 run osmo-hlr_10.42.42.2(pid=9947): Launched 10:39:03.765813 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:04.443073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9949): Launched 10:39:04.793253 run osmo-stp_10.42.42.5(pid=9950): Launched 10:39:05.044781 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:05.701249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9952): Launched 10:39:05.840868 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:06.127710 run patchelf(pid=9953): Launched 10:39:06.329750 run osmo-stp_10.42.42.5(pid=9950): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9950)] 10:39:06.472648 run osmo-stp_10.42.42.5(pid=9950): stdout: | (launched: 2022-12-13_10:39:04.732477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:06.619611 run osmo-stp_10.42.42.5(pid=9950): stderr: | 20221213103905028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103905029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103905029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103905029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103905030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103905030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103905030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:06.765528 run osmo-stp_10.42.42.5(pid=9950): stdout: | (launched: 2022-12-13_10:39:04.732477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:06.904659 run osmo-stp_10.42.42.5(pid=9950): stderr: | 20221213103905028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103905029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103905029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103905029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103905030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103905030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103905030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:07.069779 run patchelf(pid=9953): Terminating (SIGINT) 10:39:07.260873 run patchelf(pid=9953): Terminated: ok {rc=0} 10:39:07.399333 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9950): Process ended prematurely: osmo-stp_10.42.42.5(pid=9950) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9950)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 10:39:07.409958 tst iperf3.py:8: Test FAILED (8.6 sec) 10:39:07.439428 run osmo-hlr_10.42.42.2(pid=9947): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9947)] 10:39:07.495409 run osmo-hlr_10.42.42.2(pid=9947): stdout: | (launched: 2022-12-13_10:39:03.448120) 10:39:07.553324 run osmo-hlr_10.42.42.2(pid=9947): stderr: | 20221213103903757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103903757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103903757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103903757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103903757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103903757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103903777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103903789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103903789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103903789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:07.609465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9942): Terminating (SIGTERM) 10:39:07.653247 run iperf3-srv_10.42.42.10(pid=9943): Terminating (SIGTERM) 10:39:07.701819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9946): Terminating (SIGTERM) 10:39:07.748433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9949): Terminating (SIGTERM) 10:39:07.795766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9952): Terminating (SIGTERM) 10:39:07.843409 --- ParallelTerminationStrategy: PID 9942 died... 10:39:07.865857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9942): Terminated: ok {rc=0} 10:39:07.917807 --- ParallelTerminationStrategy: PID 9943 died... 10:39:07.940265 run iperf3-srv_10.42.42.10(pid=9943): Terminated {rc=256} 10:39:07.989901 --- ParallelTerminationStrategy: PID 9946 died... 10:39:08.011564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9946): Terminated: ok {rc=0} 10:39:08.060891 --- ParallelTerminationStrategy: PID 9949 died... 10:39:08.082977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9949): Terminated: ok {rc=0} 10:39:08.134294 --- ParallelTerminationStrategy: PID 9952 died... 10:39:08.155121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9952): Terminated: ok {rc=0} 10:39:08.249425 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:39:09.409528 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:09.422937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:39:09.499196 tst iperf3m4.py: using LAC 33370 10:39:09.635398 tst iperf3m4.py: using RAC 220 10:39:09.768751 tst iperf3m4.py: using CellId 33370 10:39:09.901355 tst iperf3m4.py: using BVCI 33371 10:39:10.027556 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:10.040219 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:10.052859 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:10.065277 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:10.078772 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:10.092559 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:10.107213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:10.121838 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:10.135753 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:39:10.264115 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:39:10.396723 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:39:10.525117 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:39:10.651616 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:39:10.884444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:11.231744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9955): Launched 10:39:11.520582 run iperf3-srv_10.42.42.10(pid=9956): Launched 10:39:11.645693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:39:11.867683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:12.198788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9957): Launched 10:39:12.484817 run iperf3-srv_10.42.42.10(pid=9958): Launched 10:39:12.609698 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:39:12.831014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:13.162074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9959): Launched 10:39:13.448217 run iperf3-srv_10.42.42.10(pid=9960): Launched 10:39:13.572272 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:39:13.793070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:14.123505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9961): Launched 10:39:14.411231 run iperf3-srv_10.42.42.10(pid=9962): Launched 10:39:14.535544 tst iperf3m4.py:8: start network... 10:39:14.756938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:15.265924 run create_hlr_db(pid=9963): Launched 10:39:15.392021 bus /gobi_6: Setting Powered False 10:39:16.456607 run create_hlr_db(pid=9963): Terminated: ok {rc=0} 10:39:16.927817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9965): Launched 10:39:17.272760 run osmo-hlr_10.42.42.2(pid=9966): Launched 10:39:17.401631 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:17.975784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9968): Launched 10:39:18.306662 run osmo-stp_10.42.42.5(pid=9969): Launched 10:39:18.433739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:18.999981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9971): Launched 10:39:19.127436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:19.405532 run patchelf(pid=9972): Launched 10:39:19.588166 run osmo-stp_10.42.42.5(pid=9969): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9969)] 10:39:19.727289 run osmo-stp_10.42.42.5(pid=9969): stdout: | (launched: 2022-12-13_10:39:18.246156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:19.867826 run osmo-stp_10.42.42.5(pid=9969): stderr: | 20221213103918437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103918437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103918437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103918438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103918438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103918438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103918438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:20.007980 run osmo-stp_10.42.42.5(pid=9969): stdout: | (launched: 2022-12-13_10:39:18.246156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:20.142190 run osmo-stp_10.42.42.5(pid=9969): stderr: | 20221213103918437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103918437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103918437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103918438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103918438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103918438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103918438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:20.301515 run patchelf(pid=9972): Terminating (SIGINT) 10:39:20.486409 run patchelf(pid=9972): Terminated: ok {rc=0} 10:39:20.619754 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9969): Process ended prematurely: osmo-stp_10.42.42.5(pid=9969) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9969)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:39:20.630129 tst iperf3m4.py:8: Test FAILED (11.3 sec) 10:39:20.658890 run osmo-hlr_10.42.42.2(pid=9966): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9966)] 10:39:20.710229 run osmo-hlr_10.42.42.2(pid=9966): stdout: | (launched: 2022-12-13_10:39:17.211940) 10:39:20.762845 run osmo-hlr_10.42.42.2(pid=9966): stderr: | 20221213103917407 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103917407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103917407 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103917407 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103917408 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103917408 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103917420 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103917428 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103917429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103917429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:20.815890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9955): Terminating (SIGTERM) 10:39:20.858106 run iperf3-srv_10.42.42.10(pid=9956): Terminating (SIGTERM) 10:39:20.900802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9957): Terminating (SIGTERM) 10:39:20.943558 run iperf3-srv_10.42.42.10(pid=9958): Terminating (SIGTERM) 10:39:20.986027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9959): Terminating (SIGTERM) 10:39:21.028554 run iperf3-srv_10.42.42.10(pid=9960): Terminating (SIGTERM) 10:39:21.070798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9961): Terminating (SIGTERM) 10:39:21.113186 run iperf3-srv_10.42.42.10(pid=9962): Terminating (SIGTERM) 10:39:21.155377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9965): Terminating (SIGTERM) 10:39:21.197711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9968): Terminating (SIGTERM) 10:39:21.240134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9971): Terminating (SIGTERM) 10:39:21.282878 --- ParallelTerminationStrategy: PID 9955 died... 10:39:21.303255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9955): Terminated: ok {rc=0} 10:39:21.350806 --- ParallelTerminationStrategy: PID 9956 died... 10:39:21.370859 run iperf3-srv_10.42.42.10(pid=9956): Terminated {rc=256} 10:39:21.417374 --- ParallelTerminationStrategy: PID 9957 died... 10:39:21.437132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9957): Terminated: ok {rc=0} 10:39:21.483543 --- ParallelTerminationStrategy: PID 9958 died... 10:39:21.503311 run iperf3-srv_10.42.42.10(pid=9958): Terminated {rc=256} 10:39:21.549643 --- ParallelTerminationStrategy: PID 9959 died... 10:39:21.569553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9959): Terminated: ok {rc=0} 10:39:21.615871 --- ParallelTerminationStrategy: PID 9960 died... 10:39:21.635616 run iperf3-srv_10.42.42.10(pid=9960): Terminated {rc=256} 10:39:21.682029 --- ParallelTerminationStrategy: PID 9961 died... 10:39:21.701950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9961): Terminated: ok {rc=0} 10:39:21.748435 --- ParallelTerminationStrategy: PID 9962 died... 10:39:21.768490 run iperf3-srv_10.42.42.10(pid=9962): Terminated {rc=256} 10:39:21.814898 --- ParallelTerminationStrategy: PID 9965 died... 10:39:21.834853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9965): Terminated: ok {rc=0} 10:39:21.881807 --- ParallelTerminationStrategy: PID 9968 died... 10:39:21.901754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9968): Terminated: ok {rc=0} 10:39:21.948664 --- ParallelTerminationStrategy: PID 9971 died... 10:39:21.968809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9971): Terminated: ok {rc=0} 10:39:22.058594 bus /gobi_4: Setting Powered False 10:39:23.159703 bus /gobi_4: Setting Powered False 10:39:24.278551 bus /gobi_1: Setting Powered False 10:39:25.378503 bus /gobi_1: Setting Powered False 10:39:26.496866 bus /gobi_0: Setting Powered False 10:39:27.597571 bus /gobi_0: Setting Powered False 10:39:28.717197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:39:29.820449 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:29.832520 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:39:29.905302 tst ping.py: using LAC 33371 10:39:30.032922 tst ping.py: using RAC 221 10:39:30.151254 tst ping.py: using CellId 33371 10:39:30.273325 tst ping.py: using BVCI 33372 10:39:30.383694 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:30.394933 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:30.406068 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:30.416794 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:30.427472 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:30.438243 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:30.449494 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:30.460294 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:39:30.580492 tst ping.py:19: start network... 10:39:30.796897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:31.317950 run create_hlr_db(pid=9973): Launched 10:39:31.480734 bus /gobi_6: Setting Powered False 10:39:32.544603 run create_hlr_db(pid=9973): Terminated: ok {rc=0} 10:39:32.997671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9975): Launched 10:39:33.320854 run osmo-hlr_10.42.42.2(pid=9976): Launched 10:39:33.445202 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:33.974845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9978): Launched 10:39:34.275903 run osmo-stp_10.42.42.5(pid=9979): Launched 10:39:34.390271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:34.908408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9981): Launched 10:39:35.023421 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:35.277444 run patchelf(pid=9982): Launched 10:39:35.443207 run osmo-stp_10.42.42.5(pid=9979): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9979)] 10:39:35.569376 run osmo-stp_10.42.42.5(pid=9979): stdout: | (launched: 2022-12-13_10:39:34.220170) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:35.697330 run osmo-stp_10.42.42.5(pid=9979): stderr: | 20221213103934389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103934389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103934389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103934390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103934390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103934390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103934390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:35.825231 run osmo-stp_10.42.42.5(pid=9979): stdout: | (launched: 2022-12-13_10:39:34.220170) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:35.947718 run osmo-stp_10.42.42.5(pid=9979): stderr: | 20221213103934389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103934389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103934389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103934390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103934390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103934390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103934390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:36.092048 run patchelf(pid=9982): Terminating (SIGINT) 10:39:36.261588 run patchelf(pid=9982): Terminated: ok {rc=0} 10:39:36.382986 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9979): Process ended prematurely: osmo-stp_10.42.42.5(pid=9979) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9979)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 10:39:36.391855 tst ping.py:22: Test FAILED (6.6 sec) 10:39:36.418523 run osmo-hlr_10.42.42.2(pid=9976): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9976)] 10:39:36.466651 run osmo-hlr_10.42.42.2(pid=9976): stdout: | (launched: 2022-12-13_10:39:33.260870) 10:39:36.517072 run osmo-hlr_10.42.42.2(pid=9976): stderr: | 20221213103933455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103933455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103933455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103933455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103933455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103933455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103933467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103933478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103933478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103933478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:36.567357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9975): Terminating (SIGTERM) 10:39:36.607398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9978): Terminating (SIGTERM) 10:39:36.647520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9981): Terminating (SIGTERM) 10:39:36.687792 --- ParallelTerminationStrategy: PID 9975 died... 10:39:36.707327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9975): Terminated: ok {rc=0} 10:39:36.751769 --- ParallelTerminationStrategy: PID 9978 died... 10:39:36.770658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9978): Terminated: ok {rc=0} 10:39:36.814950 --- ParallelTerminationStrategy: PID 9981 died... 10:39:36.834017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9981): Terminated: ok {rc=0} 10:39:36.920320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:39:38.009632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:38.021850 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:39:38.094346 tst ping_idle_ping.py: using LAC 33372 10:39:38.221707 tst ping_idle_ping.py: using RAC 222 10:39:38.347385 tst ping_idle_ping.py: using CellId 33372 10:39:38.473458 tst ping_idle_ping.py: using BVCI 33373 10:39:38.593167 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:38.604873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:38.616495 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:38.628060 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:38.640386 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:38.652660 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:38.665372 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:38.677581 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:39:38.800115 tst ping_idle_ping.py:24: start network... 10:39:39.017625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:39.525914 run create_hlr_db(pid=9983): Launched 10:39:39.650948 bus /gobi_6: Setting Powered False 10:39:40.714823 run create_hlr_db(pid=9983): Terminated: ok {rc=0} 10:39:41.147369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9985): Launched 10:39:41.450477 run osmo-hlr_10.42.42.2(pid=9986): Launched 10:39:41.566433 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:42.086616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9988): Launched 10:39:42.389364 run osmo-stp_10.42.42.5(pid=9989): Launched 10:39:42.503255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:43.024338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9991): Launched 10:39:43.138398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:43.391983 run patchelf(pid=9992): Launched 10:39:43.557956 run osmo-stp_10.42.42.5(pid=9989): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9989)] 10:39:43.684498 run osmo-stp_10.42.42.5(pid=9989): stdout: | (launched: 2022-12-13_10:39:42.333532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:43.812465 run osmo-stp_10.42.42.5(pid=9989): stderr: | 20221213103942501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103942501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103942501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103942502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103942502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103942502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103942502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:43.940873 run osmo-stp_10.42.42.5(pid=9989): stdout: | (launched: 2022-12-13_10:39:42.333532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:44.063459 run osmo-stp_10.42.42.5(pid=9989): stderr: | 20221213103942501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103942501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103942501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103942502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103942502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103942502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103942502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:44.208896 run patchelf(pid=9992): Terminating (SIGINT) 10:39:44.377342 run patchelf(pid=9992): Terminated: ok {rc=0} 10:39:44.498741 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9989): Process ended prematurely: osmo-stp_10.42.42.5(pid=9989) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9989)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:39:44.507668 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:39:44.534204 run osmo-hlr_10.42.42.2(pid=9986): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9986)] 10:39:44.582422 run osmo-hlr_10.42.42.2(pid=9986): stdout: | (launched: 2022-12-13_10:39:41.394192) 10:39:44.631792 run osmo-hlr_10.42.42.2(pid=9986): stderr: | 20221213103941568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103941568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103941568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103941568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103941568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103941568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103941580 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103941589 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103941589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103941589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:44.681673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9985): Terminating (SIGTERM) 10:39:44.721620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9988): Terminating (SIGTERM) 10:39:44.761534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9991): Terminating (SIGTERM) 10:39:44.801641 --- ParallelTerminationStrategy: PID 9985 died... 10:39:44.820739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9985): Terminated: ok {rc=0} 10:39:44.864776 --- ParallelTerminationStrategy: PID 9988 died... 10:39:44.883533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9988): Terminated: ok {rc=0} 10:39:44.927478 --- ParallelTerminationStrategy: PID 9991 died... 10:39:44.946161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9991): Terminated: ok {rc=0} 10:39:45.029570 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:39:46.345605 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:39:46.357275 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:39:46.404735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:39:46.456260 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:39:46.571927 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:39:46.606601 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:39:46.646680 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:39:47.267138 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:39:47.325182 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:47.336644 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:39:47.415556 tst cs_paging_gprs_active.py: using LAC 33373 10:39:47.544799 tst cs_paging_gprs_active.py: using RAC 223 10:39:47.674756 tst cs_paging_gprs_active.py: using CellId 33373 10:39:47.802948 tst cs_paging_gprs_active.py: using BVCI 33374 10:39:47.923876 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:47.935570 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:47.946819 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:47.958097 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:47.969648 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:47.981236 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:47.992831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:48.004345 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:48.016049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:39:48.134552 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:39:48.251315 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:39:48.457721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:48.766510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9996): Launched 10:39:49.034732 run iperf3-srv_10.42.42.10(pid=9997): Launched 10:39:49.151504 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:39:49.356679 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:49.663690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9998): Launched 10:39:49.930877 run iperf3-srv_10.42.42.10(pid=9999): Launched 10:39:50.047149 tst cs_paging_gprs_active.py:38: start network... 10:39:50.251387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:50.725090 run create_hlr_db(pid=10000): Launched 10:39:50.849352 bus /gobi_6: Setting Powered False 10:39:51.911013 run create_hlr_db(pid=10000): Terminated: ok {rc=0} 10:39:52.337698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10002): Launched 10:39:52.644221 run osmo-hlr_10.42.42.2(pid=10003): Launched 10:39:52.760276 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:53.284064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10005): Launched 10:39:53.589115 run osmo-stp_10.42.42.5(pid=10006): Launched 10:39:53.705867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:54.233346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10008): Launched 10:39:54.349867 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:54.609087 run patchelf(pid=10009): Launched 10:39:54.779597 run osmo-stp_10.42.42.5(pid=10006): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10006)] 10:39:54.908802 run osmo-stp_10.42.42.5(pid=10006): stdout: | (launched: 2022-12-13_10:39:53.532361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:55.039613 run osmo-stp_10.42.42.5(pid=10006): stderr: | 20221213103953698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103953698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103953698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103953699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103953699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103953699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103953699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:55.170475 run osmo-stp_10.42.42.5(pid=10006): stdout: | (launched: 2022-12-13_10:39:53.532361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:55.295187 run osmo-stp_10.42.42.5(pid=10006): stderr: | 20221213103953698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213103953698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213103953698 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213103953699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213103953699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213103953699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213103953699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:55.443219 run patchelf(pid=10009): Terminating (SIGINT) 10:39:55.615139 run patchelf(pid=10009): Terminated: ok {rc=0} 10:39:55.738995 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10006): Process ended prematurely: osmo-stp_10.42.42.5(pid=10006) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10006)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:39:55.748550 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 10:39:55.775598 run osmo-hlr_10.42.42.2(pid=10003): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10003)] 10:39:55.823560 run osmo-hlr_10.42.42.2(pid=10003): stdout: | (launched: 2022-12-13_10:39:52.586845) 10:39:55.873079 run osmo-hlr_10.42.42.2(pid=10003): stderr: | 20221213103952764 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213103952764 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213103952764 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213103952764 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213103952764 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213103952764 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213103952776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213103952785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213103952785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213103952785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:55.923182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9996): Terminating (SIGTERM) 10:39:55.962953 run iperf3-srv_10.42.42.10(pid=9997): Terminating (SIGTERM) 10:39:56.002516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9998): Terminating (SIGTERM) 10:39:56.042308 run iperf3-srv_10.42.42.10(pid=9999): Terminating (SIGTERM) 10:39:56.081898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10002): Terminating (SIGTERM) 10:39:56.121912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10005): Terminating (SIGTERM) 10:39:56.161705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10008): Terminating (SIGTERM) 10:39:56.201630 --- ParallelTerminationStrategy: PID 9996 died... 10:39:56.220770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9996): Terminated: ok {rc=0} 10:39:56.265011 --- ParallelTerminationStrategy: PID 9997 died... 10:39:56.283588 run iperf3-srv_10.42.42.10(pid=9997): Terminated {rc=256} 10:39:56.327224 --- ParallelTerminationStrategy: PID 9998 died... 10:39:56.345772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9998): Terminated: ok {rc=0} 10:39:56.389474 --- ParallelTerminationStrategy: PID 9999 died... 10:39:56.408052 run iperf3-srv_10.42.42.10(pid=9999): Terminated {rc=256} 10:39:56.451794 --- ParallelTerminationStrategy: PID 10002 died... 10:39:56.470377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10002): Terminated: ok {rc=0} 10:39:56.514456 --- ParallelTerminationStrategy: PID 10005 died... 10:39:56.533216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10005): Terminated: ok {rc=0} 10:39:56.577186 --- ParallelTerminationStrategy: PID 10008 died... 10:39:56.595703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10008): Terminated: ok {rc=0} 10:39:56.681842 bus /gobi_0: Setting Powered False 10:39:57.785134 bus /gobi_0: Setting Powered False 10:39:58.902313 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:40:00.053259 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:00.065506 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:40:00.141661 tst iperf3.py: using LAC 33374 10:40:00.263746 tst iperf3.py: using RAC 224 10:40:00.386139 tst iperf3.py: using CellId 33374 10:40:00.507859 tst iperf3.py: using BVCI 33375 10:40:00.620598 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:00.631803 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:00.642620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:00.653456 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:00.664253 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:00.675081 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:00.686340 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:00.697219 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:00.708118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:40:00.828399 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:40:01.063358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:40:01.420782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10014): Launched 10:40:01.725772 run iperf3-srv_10.42.42.10(pid=10015): Launched 10:40:01.854441 tst iperf3.py:8: start network... 10:40:02.064304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:02.546867 run create_hlr_db(pid=10016): Launched 10:40:02.673620 bus /gobi_6: Setting Powered False 10:40:03.734126 run create_hlr_db(pid=10016): Terminated: ok {rc=0} 10:40:04.161268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10018): Launched 10:40:04.467234 run osmo-hlr_10.42.42.2(pid=10019): Launched 10:40:04.582713 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:05.108883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10021): Launched 10:40:05.414753 run osmo-stp_10.42.42.5(pid=10022): Launched 10:40:05.530954 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:06.056708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10024): Launched 10:40:06.173243 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:06.431619 run patchelf(pid=10025): Launched 10:40:06.601396 run osmo-stp_10.42.42.5(pid=10022): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10022)] 10:40:06.730997 run osmo-stp_10.42.42.5(pid=10022): stdout: | (launched: 2022-12-13_10:40:05.358057) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:06.861899 run osmo-stp_10.42.42.5(pid=10022): stderr: | 20221213104005525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104005525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104005526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104005526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104005527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104005527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104005527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:06.992891 run osmo-stp_10.42.42.5(pid=10022): stdout: | (launched: 2022-12-13_10:40:05.358057) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:07.118193 run osmo-stp_10.42.42.5(pid=10022): stderr: | 20221213104005525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104005525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104005526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104005526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104005527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104005527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104005527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:07.266464 run patchelf(pid=10025): Terminating (SIGINT) 10:40:07.437971 run patchelf(pid=10025): Terminated: ok {rc=0} 10:40:07.561817 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10022): Process ended prematurely: osmo-stp_10.42.42.5(pid=10022) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10022)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 10:40:07.571146 tst iperf3.py:8: Test FAILED (7.6 sec) 10:40:07.598097 run osmo-hlr_10.42.42.2(pid=10019): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10019)] 10:40:07.646066 run osmo-hlr_10.42.42.2(pid=10019): stdout: | (launched: 2022-12-13_10:40:04.410347) 10:40:07.695743 run osmo-hlr_10.42.42.2(pid=10019): stderr: | 20221213104004585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104004585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104004585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104004585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104004585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104004586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104004598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104004607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104004607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104004607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:07.745792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10014): Terminating (SIGTERM) 10:40:07.785941 run iperf3-srv_10.42.42.10(pid=10015): Terminating (SIGTERM) 10:40:07.826396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10018): Terminating (SIGTERM) 10:40:07.866440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10021): Terminating (SIGTERM) 10:40:07.906221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10024): Terminating (SIGTERM) 10:40:07.946270 --- ParallelTerminationStrategy: PID 10014 died... 10:40:07.965478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10014): Terminated: ok {rc=0} 10:40:08.009483 --- ParallelTerminationStrategy: PID 10015 died... 10:40:08.028475 run iperf3-srv_10.42.42.10(pid=10015): Terminated {rc=256} 10:40:08.072504 --- ParallelTerminationStrategy: PID 10018 died... 10:40:08.091233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10018): Terminated: ok {rc=0} 10:40:08.135405 --- ParallelTerminationStrategy: PID 10021 died... 10:40:08.154225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10021): Terminated: ok {rc=0} 10:40:08.198376 --- ParallelTerminationStrategy: PID 10024 died... 10:40:08.217165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10024): Terminated: ok {rc=0} 10:40:08.303613 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:40:09.451977 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:09.463716 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:40:09.535022 tst iperf3m4.py: using LAC 33375 10:40:09.660070 tst iperf3m4.py: using RAC 225 10:40:09.780361 tst iperf3m4.py: using CellId 33375 10:40:09.900275 tst iperf3m4.py: using BVCI 33376 10:40:10.010708 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:10.021787 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:10.032620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:10.043465 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:10.054269 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:10.065014 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:10.075948 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:10.086615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:10.097563 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:40:10.217259 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:40:10.336659 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:40:10.458305 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:40:10.576805 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:40:10.782667 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:40:11.090681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10026): Launched 10:40:11.359507 run iperf3-srv_10.42.42.10(pid=10027): Launched 10:40:11.473945 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:40:11.677726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:40:11.985256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10028): Launched 10:40:12.253736 run iperf3-srv_10.42.42.10(pid=10029): Launched 10:40:12.367241 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:40:12.570520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:40:12.878022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10030): Launched 10:40:13.145636 run iperf3-srv_10.42.42.10(pid=10031): Launched 10:40:13.259212 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:40:13.462431 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:40:13.768890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10032): Launched 10:40:14.034630 run iperf3-srv_10.42.42.10(pid=10033): Launched 10:40:14.150111 tst iperf3m4.py:8: start network... 10:40:14.353321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:14.826426 run create_hlr_db(pid=10034): Launched 10:40:14.953225 bus /gobi_6: Setting Powered False 10:40:16.027196 run create_hlr_db(pid=10034): Terminated: ok {rc=0} 10:40:16.507350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10036): Launched 10:40:16.884914 run osmo-hlr_10.42.42.2(pid=10037): Launched 10:40:17.056186 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:17.727505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10039): Launched 10:40:18.057787 run osmo-stp_10.42.42.5(pid=10040): Launched 10:40:18.182751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:18.748389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10042): Launched 10:40:18.875106 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:19.153963 run patchelf(pid=10043): Launched 10:40:19.337326 run osmo-stp_10.42.42.5(pid=10040): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10040)] 10:40:19.475565 run osmo-stp_10.42.42.5(pid=10040): stdout: | (launched: 2022-12-13_10:40:17.997197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:19.615561 run osmo-stp_10.42.42.5(pid=10040): stderr: | 20221213104018188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104018188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104018188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104018189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104018189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104018189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104018189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:19.755576 run osmo-stp_10.42.42.5(pid=10040): stdout: | (launched: 2022-12-13_10:40:17.997197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:19.889349 run osmo-stp_10.42.42.5(pid=10040): stderr: | 20221213104018188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104018188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104018188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104018189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104018189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104018189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104018189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:20.048229 run patchelf(pid=10043): Terminating (SIGINT) 10:40:20.231922 run patchelf(pid=10043): Terminated: ok {rc=0} 10:40:20.364594 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10040): Process ended prematurely: osmo-stp_10.42.42.5(pid=10040) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10040)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:40:20.375019 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:40:20.403813 run osmo-hlr_10.42.42.2(pid=10037): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10037)] 10:40:20.455195 run osmo-hlr_10.42.42.2(pid=10037): stdout: | (launched: 2022-12-13_10:40:16.824217) 10:40:20.507940 run osmo-hlr_10.42.42.2(pid=10037): stderr: | 20221213104017182 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104017182 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104017182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104017182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104017182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104017183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104017197 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104017209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104017210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104017210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:20.560848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10026): Terminating (SIGTERM) 10:40:20.603269 run iperf3-srv_10.42.42.10(pid=10027): Terminating (SIGTERM) 10:40:20.645884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10028): Terminating (SIGTERM) 10:40:20.688441 run iperf3-srv_10.42.42.10(pid=10029): Terminating (SIGTERM) 10:40:20.730949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10030): Terminating (SIGTERM) 10:40:20.773610 run iperf3-srv_10.42.42.10(pid=10031): Terminating (SIGTERM) 10:40:20.816032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10032): Terminating (SIGTERM) 10:40:20.858655 run iperf3-srv_10.42.42.10(pid=10033): Terminating (SIGTERM) 10:40:20.901489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10036): Terminating (SIGTERM) 10:40:20.944217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10039): Terminating (SIGTERM) 10:40:20.987438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10042): Terminating (SIGTERM) 10:40:21.030526 --- ParallelTerminationStrategy: PID 10026 died... 10:40:21.051249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10026): Terminated: ok {rc=0} 10:40:21.098058 --- ParallelTerminationStrategy: PID 10027 died... 10:40:21.118075 run iperf3-srv_10.42.42.10(pid=10027): Terminated {rc=256} 10:40:21.164741 --- ParallelTerminationStrategy: PID 10028 died... 10:40:21.184901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10028): Terminated: ok {rc=0} 10:40:21.231710 --- ParallelTerminationStrategy: PID 10029 died... 10:40:21.251876 run iperf3-srv_10.42.42.10(pid=10029): Terminated {rc=256} 10:40:21.298522 --- ParallelTerminationStrategy: PID 10030 died... 10:40:21.318676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10030): Terminated: ok {rc=0} 10:40:21.365597 --- ParallelTerminationStrategy: PID 10031 died... 10:40:21.385499 run iperf3-srv_10.42.42.10(pid=10031): Terminated {rc=256} 10:40:21.432207 --- ParallelTerminationStrategy: PID 10032 died... 10:40:21.452446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10032): Terminated: ok {rc=0} 10:40:21.499311 --- ParallelTerminationStrategy: PID 10033 died... 10:40:21.519500 run iperf3-srv_10.42.42.10(pid=10033): Terminated {rc=256} 10:40:21.566407 --- ParallelTerminationStrategy: PID 10036 died... 10:40:21.586816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10036): Terminated: ok {rc=0} 10:40:21.633924 --- ParallelTerminationStrategy: PID 10039 died... 10:40:21.653981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10039): Terminated: ok {rc=0} 10:40:21.701236 --- ParallelTerminationStrategy: PID 10042 died... 10:40:21.721570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10042): Terminated: ok {rc=0} 10:40:21.811461 bus /gobi_4: Setting Powered False 10:40:22.911531 bus /gobi_4: Setting Powered False 10:40:24.031594 bus /gobi_1: Setting Powered False 10:40:25.133681 bus /gobi_1: Setting Powered False 10:40:26.251669 bus /gobi_0: Setting Powered False 10:40:27.351118 bus /gobi_0: Setting Powered False 10:40:28.470449 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:40:29.573507 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:29.585082 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:40:29.655329 tst ping.py: using LAC 33376 10:40:29.772210 tst ping.py: using RAC 226 10:40:29.889289 tst ping.py: using CellId 33376 10:40:30.009892 tst ping.py: using BVCI 33377 10:40:30.119419 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:30.130471 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:30.141327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:30.152063 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:30.162892 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:30.173677 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:30.184487 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:30.195220 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:40:30.309384 tst ping.py:19: start network... 10:40:30.508800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:31.002242 run create_hlr_db(pid=10044): Launched 10:40:31.166201 bus /gobi_6: Setting Powered False 10:40:32.229531 run create_hlr_db(pid=10044): Terminated: ok {rc=0} 10:40:32.685646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10046): Launched 10:40:33.009060 run osmo-hlr_10.42.42.2(pid=10047): Launched 10:40:33.133868 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:33.697532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10049): Launched 10:40:34.020141 run osmo-stp_10.42.42.5(pid=10050): Launched 10:40:34.143932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:34.698989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10052): Launched 10:40:34.823158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:35.095622 run patchelf(pid=10053): Launched 10:40:35.275068 run osmo-stp_10.42.42.5(pid=10050): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10050)] 10:40:35.411343 run osmo-stp_10.42.42.5(pid=10050): stdout: | (launched: 2022-12-13_10:40:33.960911) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:35.549257 run osmo-stp_10.42.42.5(pid=10050): stderr: | 20221213104034151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104034151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104034151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104034152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104034152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104034152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104034152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:35.686712 run osmo-stp_10.42.42.5(pid=10050): stdout: | (launched: 2022-12-13_10:40:33.960911) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:35.818668 run osmo-stp_10.42.42.5(pid=10050): stderr: | 20221213104034151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104034151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104034151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104034152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104034152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104034152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104034152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:35.975015 run patchelf(pid=10053): Terminating (SIGINT) 10:40:36.155551 run patchelf(pid=10053): Terminated: ok {rc=0} 10:40:36.285600 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10050): Process ended prematurely: osmo-stp_10.42.42.5(pid=10050) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10050)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 10:40:36.295116 tst ping.py:22: Test FAILED (6.7 sec) 10:40:36.323125 run osmo-hlr_10.42.42.2(pid=10047): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10047)] 10:40:36.374691 run osmo-hlr_10.42.42.2(pid=10047): stdout: | (launched: 2022-12-13_10:40:32.949371) 10:40:36.427145 run osmo-hlr_10.42.42.2(pid=10047): stderr: | 20221213104033146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104033146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104033146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104033146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104033146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104033146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104033158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104033166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104033166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104033166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:36.479726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10046): Terminating (SIGTERM) 10:40:36.521669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10049): Terminating (SIGTERM) 10:40:36.564124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10052): Terminating (SIGTERM) 10:40:36.606783 --- ParallelTerminationStrategy: PID 10046 died... 10:40:36.627497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10046): Terminated: ok {rc=0} 10:40:36.674399 --- ParallelTerminationStrategy: PID 10049 died... 10:40:36.694899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10049): Terminated: ok {rc=0} 10:40:36.741510 --- ParallelTerminationStrategy: PID 10052 died... 10:40:36.761535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10052): Terminated: ok {rc=0} 10:40:36.850612 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:40:37.938767 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:37.951111 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:40:38.026301 tst ping_idle_ping.py: using LAC 33377 10:40:38.153747 tst ping_idle_ping.py: using RAC 227 10:40:38.281233 tst ping_idle_ping.py: using CellId 33377 10:40:38.408388 tst ping_idle_ping.py: using BVCI 33378 10:40:38.525080 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:38.536621 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:38.548040 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:38.559327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:38.570848 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:38.582670 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:38.594366 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:38.605959 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:40:38.722862 tst ping_idle_ping.py:24: start network... 10:40:38.923712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:39.393183 run create_hlr_db(pid=10054): Launched 10:40:39.515668 bus /gobi_6: Setting Powered False 10:40:40.576630 run create_hlr_db(pid=10054): Terminated: ok {rc=0} 10:40:40.997274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10056): Launched 10:40:41.298698 run osmo-hlr_10.42.42.2(pid=10057): Launched 10:40:41.412060 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:41.928815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10059): Launched 10:40:42.230588 run osmo-stp_10.42.42.5(pid=10060): Launched 10:40:42.344674 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:42.864389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10062): Launched 10:40:42.979499 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:43.235094 run patchelf(pid=10063): Launched 10:40:43.402213 run osmo-stp_10.42.42.5(pid=10060): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10060)] 10:40:43.529644 run osmo-stp_10.42.42.5(pid=10060): stdout: | (launched: 2022-12-13_10:40:42.174731) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:43.658494 run osmo-stp_10.42.42.5(pid=10060): stderr: | 20221213104042341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104042342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104042342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104042342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104042343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104042343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104042343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:43.787105 run osmo-stp_10.42.42.5(pid=10060): stdout: | (launched: 2022-12-13_10:40:42.174731) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:43.910675 run osmo-stp_10.42.42.5(pid=10060): stderr: | 20221213104042341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104042342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104042342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104042342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104042343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104042343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104042343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:44.056643 run patchelf(pid=10063): Terminating (SIGINT) 10:40:44.226856 run patchelf(pid=10063): Terminated: ok {rc=0} 10:40:44.349548 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10060): Process ended prematurely: osmo-stp_10.42.42.5(pid=10060) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10060)] [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:40:44.358544 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:40:44.385108 run osmo-hlr_10.42.42.2(pid=10057): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10057)] 10:40:44.432887 run osmo-hlr_10.42.42.2(pid=10057): stdout: | (launched: 2022-12-13_10:40:41.242997) 10:40:44.482246 run osmo-hlr_10.42.42.2(pid=10057): stderr: | 20221213104041417 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104041417 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104041417 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104041417 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104041417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104041417 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104041430 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104041438 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104041439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104041439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:44.531929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10056): Terminating (SIGTERM) 10:40:44.571835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10059): Terminating (SIGTERM) 10:40:44.611616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10062): Terminating (SIGTERM) 10:40:44.651740 --- ParallelTerminationStrategy: PID 10056 died... 10:40:44.671081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10056): Terminated: ok {rc=0} 10:40:44.715406 --- ParallelTerminationStrategy: PID 10059 died... 10:40:44.734350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10059): Terminated: ok {rc=0} 10:40:44.778385 --- ParallelTerminationStrategy: PID 10062 died... 10:40:44.797300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10062): Terminated: ok {rc=0} 10:40:44.882808 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:40:46.204645 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:40:46.215982 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:40:46.254338 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:40:46.291968 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:40:46.350039 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:40:46.405658 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:40:46.453641 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:40:46.986085 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:40:46.993584 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:47.006376 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:40:47.086421 tst switch_tch_pdch.py: using LAC 33378 10:40:47.215768 tst switch_tch_pdch.py: using RAC 228 10:40:47.349378 tst switch_tch_pdch.py: using CellId 33378 10:40:47.466634 tst switch_tch_pdch.py: using BVCI 33379 10:40:47.574686 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:47.585925 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:47.597556 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:47.608667 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:47.619680 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:47.630645 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:47.641845 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:47.652789 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:40:47.772662 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:40:47.891155 tst switch_tch_pdch.py:51: start network... 10:40:48.093280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:48.559575 run create_hlr_db(pid=10067): Launched 10:40:48.685039 bus /gobi_6: Setting Powered False 10:40:49.749112 run create_hlr_db(pid=10067): Terminated: ok {rc=0} 10:40:50.180275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10069): Launched 10:40:50.480262 run osmo-hlr_10.42.42.2(pid=10070): Launched 10:40:50.594833 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:51.111689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10072): Launched 10:40:51.411286 run osmo-stp_10.42.42.5(pid=10073): Launched 10:40:51.524677 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:52.062428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10079): Launched 10:40:52.186822 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:52.459207 run patchelf(pid=10080): Launched 10:40:52.639349 run osmo-stp_10.42.42.5(pid=10073): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10073)] 10:40:52.776014 run osmo-stp_10.42.42.5(pid=10073): stdout: | (launched: 2022-12-13_10:40:51.355755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:52.914238 run osmo-stp_10.42.42.5(pid=10073): stderr: | 20221213104051523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104051523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104051523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104051524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104051524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104051524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104051524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:53.052023 run osmo-stp_10.42.42.5(pid=10073): stdout: | (launched: 2022-12-13_10:40:51.355755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:53.184090 run osmo-stp_10.42.42.5(pid=10073): stderr: | 20221213104051523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104051523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104051523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104051524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104051524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104051524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104051524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:53.340518 run patchelf(pid=10080): Terminating (SIGINT) 10:40:53.520741 run patchelf(pid=10080): Terminated: ok {rc=0} 10:40:53.651055 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10073): Process ended prematurely: osmo-stp_10.42.42.5(pid=10073) [trial-2388↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10073)] [trial-2388↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:40:53.660679 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 10:40:53.688575 run osmo-hlr_10.42.42.2(pid=10070): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10070)] 10:40:53.739874 run osmo-hlr_10.42.42.2(pid=10070): stdout: | (launched: 2022-12-13_10:40:50.424515) 10:40:53.792248 run osmo-hlr_10.42.42.2(pid=10070): stderr: | 20221213104050599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104050599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104050599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104050599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104050599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104050599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104050611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104050620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104050620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104050620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:53.845207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10069): Terminating (SIGTERM) 10:40:53.886735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10072): Terminating (SIGTERM) 10:40:53.929765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10079): Terminating (SIGTERM) 10:40:53.972445 --- ParallelTerminationStrategy: PID 10069 died... 10:40:53.993081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10069): Terminated: ok {rc=0} 10:40:54.039599 --- ParallelTerminationStrategy: PID 10072 died... 10:40:54.059552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10072): Terminated: ok {rc=0} 10:40:54.106076 --- ParallelTerminationStrategy: PID 10079 died... 10:40:54.125950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10079): Terminated: ok {rc=0} 10:40:54.215194 bus /gobi_0: Setting Powered False 10:40:55.314647 bus /gobi_0: Setting Powered False 10:40:56.431811 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:40:57.682799 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:40:57.688638 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:40:57.722053 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:40:57.755851 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:40:57.809832 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:40:57.843629 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:40:57.877632 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:40:58.430620 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:40:58.435598 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:58.446647 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:40:58.515832 tst switch_tch_pdch.py: using LAC 33379 10:40:58.632853 tst switch_tch_pdch.py: using RAC 229 10:40:58.759067 tst switch_tch_pdch.py: using CellId 33379 10:40:58.885837 tst switch_tch_pdch.py: using BVCI 33380 10:40:59.005064 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:59.016665 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:59.027997 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:59.039365 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:59.050910 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:59.062635 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:59.074365 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:59.086157 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:40:59.203260 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:40:59.318938 tst switch_tch_pdch.py:51: start network... 10:40:59.519972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:59.961356 run create_hlr_db(pid=10084): Launched 10:41:00.089968 bus /gobi_6: Setting Powered False 10:41:01.153492 run create_hlr_db(pid=10084): Terminated: ok {rc=0} 10:41:01.591265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10086): Launched 10:41:01.934461 run osmo-hlr_10.42.42.2(pid=10087): Launched 10:41:02.146698 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:02.675721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10089): Launched 10:41:02.998903 run osmo-stp_10.42.42.5(pid=10090): Launched 10:41:03.122343 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:41:03.648879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10092): Launched 10:41:03.773190 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:41:04.046232 run patchelf(pid=10093): Launched 10:41:04.225509 run osmo-stp_10.42.42.5(pid=10090): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10090)] 10:41:04.361736 run osmo-stp_10.42.42.5(pid=10090): stdout: | (launched: 2022-12-13_10:41:02.939337) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:04.499616 run osmo-stp_10.42.42.5(pid=10090): stderr: | 20221213104103129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104103129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104103129 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104103129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104103130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104103130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104103130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:04.637720 run osmo-stp_10.42.42.5(pid=10090): stdout: | (launched: 2022-12-13_10:41:02.939337) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:04.769566 run osmo-stp_10.42.42.5(pid=10090): stderr: | 20221213104103129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104103129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104103129 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104103129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104103130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104103130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104103130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:04.926479 run patchelf(pid=10093): Terminating (SIGINT) 10:41:05.107431 run patchelf(pid=10093): Terminated: ok {rc=0} 10:41:05.238189 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10090): Process ended prematurely: osmo-stp_10.42.42.5(pid=10090) [trial-2388↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10090)] [trial-2388↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:41:05.247816 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 10:41:05.275711 run osmo-hlr_10.42.42.2(pid=10087): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10087)] 10:41:05.326961 run osmo-hlr_10.42.42.2(pid=10087): stdout: | (launched: 2022-12-13_10:41:01.873537) 10:41:05.379330 run osmo-hlr_10.42.42.2(pid=10087): stderr: | 20221213104102210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104102210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104102210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104102210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104102210 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104102210 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104102226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104102234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104102234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104102234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:05.432053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10086): Terminating (SIGTERM) 10:41:05.474243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10089): Terminating (SIGTERM) 10:41:05.516763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10092): Terminating (SIGTERM) 10:41:05.559488 --- ParallelTerminationStrategy: PID 10086 died... 10:41:05.580004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10086): Terminated: ok {rc=0} 10:41:05.626989 --- ParallelTerminationStrategy: PID 10089 died... 10:41:05.647022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10089): Terminated: ok {rc=0} 10:41:05.693675 --- ParallelTerminationStrategy: PID 10092 died... 10:41:05.713752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10092): Terminated: ok {rc=0} 10:41:05.802903 bus /gobi_0: Setting Powered False 10:41:06.902518 bus /gobi_0: Setting Powered False 10:41:08.019774 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_sms:trx-umtrx --------------------------------------------------------------------- 10:41:09.270124 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:41:09.273846 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:41:09.305570 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 10:41:09.312428 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 10:41:09.363058 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:41:09.394573 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 10:41:09.401274 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 10:41:09.939128 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 10:41:09.944244 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 10:41:09.955029 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 10:41:10.001734 tst mo_mt_sms.py: using LAC 33380 10:41:10.119674 tst mo_mt_sms.py: using RAC 230 10:41:10.238485 tst mo_mt_sms.py: using CellId 33380 10:41:10.357919 tst mo_mt_sms.py: using BVCI 33381 10:41:10.467089 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:41:10.585338 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:41:10.698888 tst mo_mt_sms.py:9: start nitb and bts... 10:41:10.900312 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:41:11.514622 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10097): Launched 10:41:11.816513 run osmo-nitb_10.42.42.2(pid=10098): Launched 10:41:11.983184 run osmo-nitb_10.42.42.2(pid=10098): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10098)] 10:41:12.117694 run osmo-nitb_10.42.42.2(pid=10098): stdout: | (launched: 2022-12-13_10:41:11.760722) 10:41:12.253561 run osmo-nitb_10.42.42.2(pid=10098): stderr: | (launched: 2022-12-13_10:41:11.805331) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:41:12.389547 run osmo-nitb_10.42.42.2(pid=10098): stdout: | (launched: 2022-12-13_10:41:11.760722) 10:41:12.519999 run osmo-nitb_10.42.42.2(pid=10098): stderr: | (launched: 2022-12-13_10:41:11.805331) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10098): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10098) [trial-2388↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10098)] 10:41:12.929921 tst osmo-nitb_10.42.42.2(pid=10098): stdout: | (launched: 2022-12-13_10:41:11.760722) 10:41:13.051731 tst osmo-nitb_10.42.42.2(pid=10098): stderr: | (launched: 2022-12-13_10:41:11.805331) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:41:13.194250 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=10098): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10098) [trial-2388↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10098)] [trial-2388↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 10:41:13.202634 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 10:41:13.209215 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10097): Terminating (SIGTERM) 10:41:13.418015 --- ParallelTerminationStrategy: PID 10097 died... 10:41:13.439616 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10097): Terminated: ok {rc=0} 10:41:13.526538 bus /sierra_3: Setting Powered False 10:41:14.626295 bus /sierra_3: Setting Powered False 10:41:15.745199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 sms:trx-umtrx --------------------------------------------------------------------- 10:41:16.951617 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:41:16.958958 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:41:17.000290 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 10:41:17.039555 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 10:41:17.107901 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:41:17.152393 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 10:41:17.184479 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 10:41:17.709852 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 10:41:17.716249 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:41:17.728290 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 10:41:17.775939 tst mo_mt_sms.py: using LAC 33381 10:41:17.895719 tst mo_mt_sms.py: using RAC 231 10:41:18.014720 tst mo_mt_sms.py: using CellId 33381 10:41:18.134550 tst mo_mt_sms.py: using BVCI 33382 10:41:18.244602 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:41:18.255257 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:41:18.265672 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:41:18.275900 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:41:18.286220 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:41:18.297111 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:41:18.412299 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:41:18.531934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:18.998679 run create_hlr_db(pid=10102): Launched 10:41:19.122917 bus /sierra_2: Setting Powered False 10:41:20.183041 run create_hlr_db(pid=10102): Terminated: ok {rc=0} 10:41:20.603423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10104): Launched 10:41:20.903070 run osmo-hlr_10.42.42.2(pid=10105): Launched 10:41:21.017896 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:21.534740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10107): Launched 10:41:21.835228 run osmo-stp_10.42.42.5(pid=10108): Launched 10:41:21.950604 run osmo-msc_10.42.42.6: Starting osmo-msc 10:41:22.490645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10110): Launched 10:41:22.790431 run osmo-msc_10.42.42.6(pid=10111): Launched 10:41:22.956855 run osmo-stp_10.42.42.5(pid=10108): ERR: Terminated: ERROR {rc=1} [trial-2388↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10108)] 10:41:23.082846 run osmo-stp_10.42.42.5(pid=10108): stdout: | (launched: 2022-12-13_10:41:21.779327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:23.209255 run osmo-stp_10.42.42.5(pid=10108): stderr: | 20221213104121949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104121949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104121950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104121950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104121951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104121951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104121951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:23.333972 run osmo-stp_10.42.42.5(pid=10108): stdout: | (launched: 2022-12-13_10:41:21.779327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:23.453654 run osmo-stp_10.42.42.5(pid=10108): stderr: | 20221213104121949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104121949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104121950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104121950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104121951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104121951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104121951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:23.595626 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10108): Process ended prematurely: osmo-stp_10.42.42.5(pid=10108) [trial-2388↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10108)] [trial-2388↪sms:trx-umtrx↪mo_mt_sms.py:16] 10:41:23.604057 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 10:41:23.629743 run osmo-hlr_10.42.42.2(pid=10105): ERR: Terminated: ERROR {rc=237} [trial-2388↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10105)] 10:41:23.677370 run osmo-hlr_10.42.42.2(pid=10105): stdout: | (launched: 2022-12-13_10:41:20.847315) 10:41:23.726831 run osmo-hlr_10.42.42.2(pid=10105): stderr: | 20221213104121022 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104121022 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104121022 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104121022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104121022 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104121022 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104121034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104121045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104121046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104121046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:23.795973 run osmo-msc_10.42.42.6(pid=10111): ERR: Terminated: ERROR {rc=2} [trial-2388↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10111)] 10:41:23.843546 run osmo-msc_10.42.42.6(pid=10111): stdout: | (launched: 2022-12-13_10:41:22.734581) 10:41:23.892687 run osmo-msc_10.42.42.6(pid=10111): stderr: | 20221213104123003 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104123003 DLGLOBAL DEBUG validating counter group 0x7f824ef45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104123004 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104123004 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104123004 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104123004 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104123006 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104123006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104123007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104123007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:41:23.942216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10104): Terminating (SIGTERM) 10:41:23.981965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10107): Terminating (SIGTERM) 10:41:24.021603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10110): Terminating (SIGTERM) 10:41:24.061518 --- ParallelTerminationStrategy: PID 10104 died... 10:41:24.080535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10104): Terminated: ok {rc=0} 10:41:24.124473 --- ParallelTerminationStrategy: PID 10107 died... 10:41:24.143104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10107): Terminated: ok {rc=0} 10:41:24.186669 --- ParallelTerminationStrategy: PID 10110 died... 10:41:24.205189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10110): Terminated: ok {rc=0} 10:41:24.291848 bus /sierra_3: Setting Powered False 10:41:25.391127 bus /sierra_3: Setting Powered False 10:41:26.504309 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 10:41:27.735593 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:41:27.739856 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:41:27.772900 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 10:41:27.781423 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 10:41:27.817869 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:41:27.852030 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 10:41:27.859678 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 10:41:28.377153 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2388 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 10:41:28.382572 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 10:41:28.393981 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 10:41:28.443228 tst assert_extension.py: using LAC 33382 10:41:28.563396 tst assert_extension.py: using RAC 232 10:41:28.680921 tst assert_extension.py: using CellId 33382 10:41:28.797613 tst assert_extension.py: using BVCI 33383 10:41:28.905779 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 10:41:29.026584 tst assert_extension.py:10: start nitb and bts... 10:41:29.244035 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:41:29.905822 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10116): Launched 10:41:30.234223 run osmo-nitb_10.42.42.2(pid=10117): Launched 10:41:30.413528 run osmo-nitb_10.42.42.2(pid=10117): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10117)] 10:41:30.557708 run osmo-nitb_10.42.42.2(pid=10117): stdout: | (launched: 2022-12-13_10:41:30.174947) 10:41:30.703623 run osmo-nitb_10.42.42.2(pid=10117): stderr: | (launched: 2022-12-13_10:41:30.222613) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:41:30.849809 run osmo-nitb_10.42.42.2(pid=10117): stdout: | (launched: 2022-12-13_10:41:30.174947) 10:41:31.005212 run osmo-nitb_10.42.42.2(pid=10117): stderr: | (launched: 2022-12-13_10:41:30.222613) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10117): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10117) [trial-2388↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10117)] 10:41:31.356698 tst osmo-nitb_10.42.42.2(pid=10117): stdout: | (launched: 2022-12-13_10:41:30.174947) 10:41:31.530692 tst osmo-nitb_10.42.42.2(pid=10117): stderr: | (launched: 2022-12-13_10:41:30.222613) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:41:31.688629 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10117): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10117) [trial-2388↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10117)] [trial-2388↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 10:41:31.698276 tst assert_extension.py:12: Test FAILED (3.3 sec) 10:41:31.705664 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10116): Terminating (SIGTERM) 10:41:31.917501 --- ParallelTerminationStrategy: PID 10116 died... 10:41:31.937434 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10116): Terminated: ok {rc=0} 10:41:32.025555 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 ussd:trx-umtrx --------------------------------------------------------------------- 10:41:33.202951 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:41:33.207386 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:41:33.239632 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 10:41:33.266531 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 10:41:33.300251 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:41:33.332244 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 10:41:33.358598 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 10:41:33.887188 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2388 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 10:41:33.892286 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:41:33.902986 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 10:41:33.950041 tst assert_extension.py: using LAC 33383 10:41:34.068424 tst assert_extension.py: using RAC 233 10:41:34.184130 tst assert_extension.py: using CellId 33383 10:41:34.299327 tst assert_extension.py: using BVCI 33384 10:41:34.407522 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:41:34.418057 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:41:34.428411 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:41:34.438780 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:41:34.449603 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:41:34.460376 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 10:41:34.580157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:35.044845 run create_hlr_db(pid=10121): Launched 10:41:35.167007 bus /sierra_2: Setting Powered False 10:41:36.226291 run create_hlr_db(pid=10121): Terminated: ok {rc=0} 10:41:36.667880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Launched 10:41:36.991332 run osmo-hlr_10.42.42.2(pid=10124): Launched 10:41:37.116190 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:37.680597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10126): Launched 10:41:38.005083 run osmo-stp_10.42.42.5(pid=10127): Launched 10:41:38.128539 run osmo-msc_10.42.42.6: Starting osmo-msc 10:41:38.708155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10129): Launched 10:41:39.032201 run osmo-msc_10.42.42.6(pid=10130): Launched 10:41:39.213680 run osmo-stp_10.42.42.5(pid=10127): ERR: Terminated: ERROR {rc=1} [trial-2388↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10127)] 10:41:39.349882 run osmo-stp_10.42.42.5(pid=10127): stdout: | (launched: 2022-12-13_10:41:37.945453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:39.486461 run osmo-stp_10.42.42.5(pid=10127): stderr: | 20221213104138136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104138136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104138136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104138136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104138137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104138137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104138137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:39.621658 run osmo-stp_10.42.42.5(pid=10127): stdout: | (launched: 2022-12-13_10:41:37.945453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:39.750632 run osmo-stp_10.42.42.5(pid=10127): stderr: | 20221213104138136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104138136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104138136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104138136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104138137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104138137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104138137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:39.904755 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10127): Process ended prematurely: osmo-stp_10.42.42.5(pid=10127) [trial-2388↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10127)] [trial-2388↪ussd:trx-umtrx↪assert_extension.py:17] 10:41:39.914173 tst assert_extension.py:17: Test FAILED (6.0 sec) 10:41:39.942095 run osmo-hlr_10.42.42.2(pid=10124): ERR: Terminated: ERROR {rc=237} [trial-2388↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10124)] 10:41:39.993646 run osmo-hlr_10.42.42.2(pid=10124): stdout: | (launched: 2022-12-13_10:41:36.931468) 10:41:40.045600 run osmo-hlr_10.42.42.2(pid=10124): stderr: | 20221213104137128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104137128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104137128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104137128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104137128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104137128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104137140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104137148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104137148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104137148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:40.118964 run osmo-msc_10.42.42.6(pid=10130): ERR: Terminated: ERROR {rc=2} [trial-2388↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10130)] 10:41:40.169343 run osmo-msc_10.42.42.6(pid=10130): stdout: | (launched: 2022-12-13_10:41:38.972498) 10:41:40.222104 run osmo-msc_10.42.42.6(pid=10130): stderr: | 20221213104139291 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104139291 DLGLOBAL DEBUG validating counter group 0x7ff1e8c33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104139291 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104139291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104139291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104139292 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104139293 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104139294 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104139294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104139294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:41:40.274911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Terminating (SIGTERM) 10:41:40.317340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10126): Terminating (SIGTERM) 10:41:40.360070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10129): Terminating (SIGTERM) 10:41:40.403119 --- ParallelTerminationStrategy: PID 10123 died... 10:41:40.423836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Terminated: ok {rc=0} 10:41:40.470931 --- ParallelTerminationStrategy: PID 10126 died... 10:41:40.491160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10126): Terminated: ok {rc=0} 10:41:40.537879 --- ParallelTerminationStrategy: PID 10129 died... 10:41:40.558016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10129): Terminated: ok {rc=0} 10:41:40.648083 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:41:41.861029 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:41:41.868339 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:41:41.901326 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:41:41.930550 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:41:41.983456 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:41:42.016641 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:41:42.043177 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:41:42.591778 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:41:42.642862 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:42.654193 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:41:42.723060 tst mo_mt_call.py: using LAC 33384 10:41:42.845198 tst mo_mt_call.py: using RAC 234 10:41:42.965676 tst mo_mt_call.py: using CellId 33384 10:41:43.086398 tst mo_mt_call.py: using BVCI 33385 10:41:43.199111 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:43.210355 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:43.221446 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:43.232101 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:43.243596 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:43.255082 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:41:43.376125 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:41:43.494433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:43.971434 run create_hlr_db(pid=10135): Launched 10:41:44.095951 bus /sierra_2: Setting Powered False 10:41:45.157769 run create_hlr_db(pid=10135): Terminated: ok {rc=0} 10:41:45.586257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10137): Launched 10:41:45.917735 run osmo-hlr_10.42.42.2(pid=10138): Launched 10:41:46.181591 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:46.791224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10140): Launched 10:41:47.120337 run osmo-stp_10.42.42.5(pid=10141): Launched 10:41:47.326191 run osmo-msc_10.42.42.6: Starting osmo-msc 10:41:47.880159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10143): Launched 10:41:48.187207 run osmo-msc_10.42.42.6(pid=10144): Launched 10:41:48.356896 run osmo-stp_10.42.42.5(pid=10141): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10141)] 10:41:48.484934 run osmo-stp_10.42.42.5(pid=10141): stdout: | (launched: 2022-12-13_10:41:47.056818) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:48.613483 run osmo-stp_10.42.42.5(pid=10141): stderr: | 20221213104147296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104147296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104147296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104147297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104147297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104147297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104147297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:48.740178 run osmo-stp_10.42.42.5(pid=10141): stdout: | (launched: 2022-12-13_10:41:47.056818) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:48.861388 run osmo-stp_10.42.42.5(pid=10141): stderr: | 20221213104147296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104147296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104147296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104147297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104147297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104147297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104147297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:49.006868 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10141): Process ended prematurely: osmo-stp_10.42.42.5(pid=10141) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10141)] [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:41:49.015669 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:41:49.042058 run osmo-hlr_10.42.42.2(pid=10138): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10138)] 10:41:49.090067 run osmo-hlr_10.42.42.2(pid=10138): stdout: | (launched: 2022-12-13_10:41:45.835693) 10:41:49.139605 run osmo-hlr_10.42.42.2(pid=10138): stderr: | 20221213104146166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104146166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104146166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104146166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104146166 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104146166 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104146191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104146199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104146199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104146200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:49.208750 run osmo-msc_10.42.42.6(pid=10144): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10144)] 10:41:49.256724 run osmo-msc_10.42.42.6(pid=10144): stdout: | (launched: 2022-12-13_10:41:48.130229) 10:41:49.306414 run osmo-msc_10.42.42.6(pid=10144): stderr: | 20221213104148401 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104148401 DLGLOBAL DEBUG validating counter group 0x7f8df749ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104148402 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104148402 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104148402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104148402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104148404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104148404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104148404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104148404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:41:49.357441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10137): Terminating (SIGTERM) 10:41:49.397812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10140): Terminating (SIGTERM) 10:41:49.437758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10143): Terminating (SIGTERM) 10:41:49.478674 --- ParallelTerminationStrategy: PID 10137 died... 10:41:49.497966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10137): Terminated: ok {rc=0} 10:41:49.542425 --- ParallelTerminationStrategy: PID 10140 died... 10:41:49.561684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10140): Terminated: ok {rc=0} 10:41:49.606076 --- ParallelTerminationStrategy: PID 10143 died... 10:41:49.624834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10143): Terminated: ok {rc=0} 10:41:49.711543 bus /sierra_3: Setting Powered False 10:41:50.812935 bus /sierra_3: Setting Powered False 10:41:51.932780 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:41:53.087011 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:53.099286 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:41:53.170351 tst mo_mt_call_osmux.py: using LAC 33385 10:41:53.299936 tst mo_mt_call_osmux.py: using RAC 235 10:41:53.427391 tst mo_mt_call_osmux.py: using CellId 33385 10:41:53.555746 tst mo_mt_call_osmux.py: using BVCI 33386 10:41:53.675038 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:53.686683 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:53.698106 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:53.709485 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:53.721284 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:53.733422 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:41:53.852324 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:41:53.974394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:54.482977 run create_hlr_db(pid=10146): Launched 10:41:54.609454 bus /sierra_2: Setting Powered False 10:41:55.674047 run create_hlr_db(pid=10146): Terminated: ok {rc=0} 10:41:56.110625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10148): Launched 10:41:56.415347 run osmo-hlr_10.42.42.2(pid=10149): Launched 10:41:56.532859 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:57.058077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10151): Launched 10:41:57.363036 run osmo-stp_10.42.42.5(pid=10152): Launched 10:41:57.478065 run osmo-msc_10.42.42.6: Starting osmo-msc 10:41:58.030469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10154): Launched 10:41:58.336298 run osmo-msc_10.42.42.6(pid=10155): Launched 10:41:58.506399 run osmo-stp_10.42.42.5(pid=10152): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10152)] 10:41:58.635520 run osmo-stp_10.42.42.5(pid=10152): stdout: | (launched: 2022-12-13_10:41:57.306432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:58.764286 run osmo-stp_10.42.42.5(pid=10152): stderr: | 20221213104157473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104157474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104157474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104157474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104157475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104157475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104157475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:58.891682 run osmo-stp_10.42.42.5(pid=10152): stdout: | (launched: 2022-12-13_10:41:57.306432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:59.013214 run osmo-stp_10.42.42.5(pid=10152): stderr: | 20221213104157473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104157474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104157474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104157474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104157475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104157475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104157475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:59.159091 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10152): Process ended prematurely: osmo-stp_10.42.42.5(pid=10152) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10152)] [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:41:59.168298 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:41:59.194846 run osmo-hlr_10.42.42.2(pid=10149): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10149)] 10:41:59.242918 run osmo-hlr_10.42.42.2(pid=10149): stdout: | (launched: 2022-12-13_10:41:56.358697) 10:41:59.292545 run osmo-hlr_10.42.42.2(pid=10149): stderr: | 20221213104156531 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104156531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104156531 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104156531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104156531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104156531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104156544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104156552 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104156552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104156552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:59.362116 run osmo-msc_10.42.42.6(pid=10155): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10155)] 10:41:59.410004 run osmo-msc_10.42.42.6(pid=10155): stdout: | (launched: 2022-12-13_10:41:58.279443) 10:41:59.459711 run osmo-msc_10.42.42.6(pid=10155): stderr: | 20221213104158551 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104158551 DLGLOBAL DEBUG validating counter group 0x7f5b6ba3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104158551 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104158551 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104158551 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104158552 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104158553 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104158554 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104158554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104158554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:41:59.509552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10148): Terminating (SIGTERM) 10:41:59.549748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10151): Terminating (SIGTERM) 10:41:59.589965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10154): Terminating (SIGTERM) 10:41:59.631378 --- ParallelTerminationStrategy: PID 10148 died... 10:41:59.650992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10148): Terminated: ok {rc=0} 10:41:59.695279 --- ParallelTerminationStrategy: PID 10151 died... 10:41:59.714119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10151): Terminated: ok {rc=0} 10:41:59.758491 --- ParallelTerminationStrategy: PID 10154 died... 10:41:59.777351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10154): Terminated: ok {rc=0} 10:41:59.863726 bus /sierra_3: Setting Powered False 10:42:00.986168 bus /sierra_3: Setting Powered False 10:42:02.163896 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:42:03.430107 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:42:03.437304 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:42:03.471082 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:42:03.498424 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:42:03.554454 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:42:03.586408 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:42:03.612760 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:42:04.161620 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:42:04.211718 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:42:04.222945 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:42:04.291653 tst mo_mt_call.py: using LAC 33386 10:42:04.411617 tst mo_mt_call.py: using RAC 236 10:42:04.540894 tst mo_mt_call.py: using CellId 33386 10:42:04.674754 tst mo_mt_call.py: using BVCI 33387 10:42:04.794690 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:42:04.806398 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:42:04.817910 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:42:04.829179 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:42:04.840809 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:42:04.852370 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:42:04.968709 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:42:05.084606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:05.558445 run create_hlr_db(pid=10164): Launched 10:42:05.685644 bus /sierra_2: Setting Powered False 10:42:06.747008 run create_hlr_db(pid=10164): Terminated: ok {rc=0} 10:42:07.172758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10166): Launched 10:42:07.476879 run osmo-hlr_10.42.42.2(pid=10167): Launched 10:42:07.592690 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:08.133440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10169): Launched 10:42:08.438125 run osmo-stp_10.42.42.5(pid=10170): Launched 10:42:08.555548 run osmo-msc_10.42.42.6: Starting osmo-msc 10:42:09.106245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10172): Launched 10:42:09.413855 run osmo-msc_10.42.42.6(pid=10173): Launched 10:42:09.583916 run osmo-stp_10.42.42.5(pid=10170): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10170)] 10:42:09.713547 run osmo-stp_10.42.42.5(pid=10170): stdout: | (launched: 2022-12-13_10:42:08.381307) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:09.842769 run osmo-stp_10.42.42.5(pid=10170): stderr: | 20221213104208550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104208550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104208550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104208551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104208552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104208552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104208552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:09.969706 run osmo-stp_10.42.42.5(pid=10170): stdout: | (launched: 2022-12-13_10:42:08.381307) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:10.091048 run osmo-stp_10.42.42.5(pid=10170): stderr: | 20221213104208550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104208550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104208550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104208551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104208552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104208552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104208552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:10.236059 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10170): Process ended prematurely: osmo-stp_10.42.42.5(pid=10170) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10170)] [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:42:10.245153 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:42:10.271678 run osmo-hlr_10.42.42.2(pid=10167): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10167)] 10:42:10.319626 run osmo-hlr_10.42.42.2(pid=10167): stdout: | (launched: 2022-12-13_10:42:07.420255) 10:42:10.369419 run osmo-hlr_10.42.42.2(pid=10167): stderr: | 20221213104207595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104207595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104207595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104207595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104207596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104207596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104207608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104207617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104207617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104207617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:10.439369 run osmo-msc_10.42.42.6(pid=10173): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10173)] 10:42:10.488279 run osmo-msc_10.42.42.6(pid=10173): stdout: | (launched: 2022-12-13_10:42:09.356916) 10:42:10.538196 run osmo-msc_10.42.42.6(pid=10173): stderr: | 20221213104209629 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104209629 DLGLOBAL DEBUG validating counter group 0x7f0c3269dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104209629 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104209629 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104209629 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104209630 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104209631 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104209632 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104209632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104209632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:42:10.588386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10166): Terminating (SIGTERM) 10:42:10.628133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10169): Terminating (SIGTERM) 10:42:10.667989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10172): Terminating (SIGTERM) 10:42:10.708104 --- ParallelTerminationStrategy: PID 10166 died... 10:42:10.727388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10166): Terminated: ok {rc=0} 10:42:10.771977 --- ParallelTerminationStrategy: PID 10169 died... 10:42:10.790910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10169): Terminated: ok {rc=0} 10:42:10.835071 --- ParallelTerminationStrategy: PID 10172 died... 10:42:10.853936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10172): Terminated: ok {rc=0} 10:42:10.940558 bus /sierra_3: Setting Powered False 10:42:12.042965 bus /sierra_3: Setting Powered False 10:42:13.163183 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:42:14.310273 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:42:14.321919 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:42:14.389964 tst mo_mt_call_osmux.py: using LAC 33387 10:42:14.511189 tst mo_mt_call_osmux.py: using RAC 237 10:42:14.631932 tst mo_mt_call_osmux.py: using CellId 33387 10:42:14.756661 tst mo_mt_call_osmux.py: using BVCI 33388 10:42:14.868370 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:42:14.879460 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:42:14.890317 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:42:14.901139 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:42:14.912007 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:42:14.922845 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:42:15.038584 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:42:15.164700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:15.675365 run create_hlr_db(pid=10175): Launched 10:42:15.802874 bus /sierra_2: Setting Powered False 10:42:16.875429 run create_hlr_db(pid=10175): Terminated: ok {rc=0} 10:42:17.333756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10177): Launched 10:42:17.666221 run osmo-hlr_10.42.42.2(pid=10178): Launched 10:42:17.791311 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:18.360076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10180): Launched 10:42:18.688680 run osmo-stp_10.42.42.5(pid=10181): Launched 10:42:18.814866 run osmo-msc_10.42.42.6: Starting osmo-msc 10:42:19.407894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10183): Launched 10:42:19.738908 run osmo-msc_10.42.42.6(pid=10184): Launched 10:42:19.923132 run osmo-stp_10.42.42.5(pid=10181): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10181)] 10:42:20.063129 run osmo-stp_10.42.42.5(pid=10181): stdout: | (launched: 2022-12-13_10:42:18.628014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:20.205501 run osmo-stp_10.42.42.5(pid=10181): stderr: | 20221213104218819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104218820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104218820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104218820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104218821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104218821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104218821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:20.343690 run osmo-stp_10.42.42.5(pid=10181): stdout: | (launched: 2022-12-13_10:42:18.628014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:20.475416 run osmo-stp_10.42.42.5(pid=10181): stderr: | 20221213104218819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104218820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104218820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104218820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104218821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104218821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104218821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:20.633032 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10181): Process ended prematurely: osmo-stp_10.42.42.5(pid=10181) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10181)] [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:42:20.642889 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:42:20.670834 run osmo-hlr_10.42.42.2(pid=10178): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10178)] 10:42:20.721880 run osmo-hlr_10.42.42.2(pid=10178): stdout: | (launched: 2022-12-13_10:42:17.605719) 10:42:20.774472 run osmo-hlr_10.42.42.2(pid=10178): stderr: | 20221213104217802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104217802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104217802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104217802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104217802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104217802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104217815 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104217823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104217823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104217823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:20.847514 run osmo-msc_10.42.42.6(pid=10184): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10184)] 10:42:20.897453 run osmo-msc_10.42.42.6(pid=10184): stdout: | (launched: 2022-12-13_10:42:19.678348) 10:42:20.950298 run osmo-msc_10.42.42.6(pid=10184): stderr: | 20221213104219998 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104219999 DLGLOBAL DEBUG validating counter group 0x7fb229823c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104219999 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104219999 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104219999 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104219999 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104220001 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104220002 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104220002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104220002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:42:21.003697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10177): Terminating (SIGTERM) 10:42:21.045790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10180): Terminating (SIGTERM) 10:42:21.088105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10183): Terminating (SIGTERM) 10:42:21.130614 --- ParallelTerminationStrategy: PID 10177 died... 10:42:21.151183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10177): Terminated: ok {rc=0} 10:42:21.198024 --- ParallelTerminationStrategy: PID 10180 died... 10:42:21.217929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10180): Terminated: ok {rc=0} 10:42:21.264653 --- ParallelTerminationStrategy: PID 10183 died... 10:42:21.284728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10183): Terminated: ok {rc=0} 10:42:21.374109 bus /sierra_3: Setting Powered False 10:42:22.473483 bus /sierra_3: Setting Powered False 10:42:23.590908 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:42:24.840696 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:42:24.847842 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:42:24.881631 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:42:24.908860 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:42:24.962194 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:42:24.995634 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:42:25.023506 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:42:25.577971 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:42:25.628742 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:25.639959 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:42:25.706579 tst mo_mt_call.py: using LAC 33388 10:42:25.825712 tst mo_mt_call.py: using RAC 238 10:42:25.945149 tst mo_mt_call.py: using CellId 33388 10:42:26.062792 tst mo_mt_call.py: using BVCI 33389 10:42:26.173172 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:26.184173 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:26.195099 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:26.205902 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:26.216703 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:26.227577 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:42:26.349182 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:42:26.469926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:26.979305 run create_hlr_db(pid=10191): Launched 10:42:27.106436 bus /sierra_2: Setting Powered False 10:42:28.171142 run create_hlr_db(pid=10191): Terminated: ok {rc=0} 10:42:28.628304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10193): Launched 10:42:28.957869 run osmo-hlr_10.42.42.2(pid=10194): Launched 10:42:29.084504 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:29.650641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10196): Launched 10:42:29.980099 run osmo-stp_10.42.42.5(pid=10197): Launched 10:42:30.107435 run osmo-msc_10.42.42.6: Starting osmo-msc 10:42:30.700917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10199): Launched 10:42:31.059263 run osmo-msc_10.42.42.6(pid=10200): Launched 10:42:31.417937 run osmo-stp_10.42.42.5(pid=10197): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10197)] 10:42:31.663996 run osmo-stp_10.42.42.5(pid=10197): stdout: | (launched: 2022-12-13_10:42:29.919089) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:32.010771 run osmo-stp_10.42.42.5(pid=10197): stderr: | 20221213104230108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104230109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104230109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104230109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104230110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104230110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104230110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:32.205135 run osmo-stp_10.42.42.5(pid=10197): stdout: | (launched: 2022-12-13_10:42:29.919089) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:32.339928 run osmo-stp_10.42.42.5(pid=10197): stderr: | 20221213104230108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104230109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104230109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104230109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104230110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104230110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104230110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:32.501092 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10197): Process ended prematurely: osmo-stp_10.42.42.5(pid=10197) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10197)] [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:42:32.511440 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 10:42:32.540139 run osmo-hlr_10.42.42.2(pid=10194): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10194)] 10:42:32.593639 run osmo-hlr_10.42.42.2(pid=10194): stdout: | (launched: 2022-12-13_10:42:28.897505) 10:42:32.647266 run osmo-hlr_10.42.42.2(pid=10194): stderr: | 20221213104229092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104229092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104229092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104229092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104229092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104229092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104229104 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104229113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104229113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104229113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:32.721889 run osmo-msc_10.42.42.6(pid=10200): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10200)] 10:42:32.773705 run osmo-msc_10.42.42.6(pid=10200): stdout: | (launched: 2022-12-13_10:42:30.995690) 10:42:32.827333 run osmo-msc_10.42.42.6(pid=10200): stderr: | 20221213104231642 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104231643 DLGLOBAL DEBUG validating counter group 0x7faede3d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104231643 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104231643 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104231643 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104231644 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104231649 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104231650 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104231651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104231651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:42:32.881178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10193): Terminating (SIGTERM) 10:42:32.923509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10196): Terminating (SIGTERM) 10:42:32.966954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10199): Terminating (SIGTERM) 10:42:33.010297 --- ParallelTerminationStrategy: PID 10193 died... 10:42:33.031084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10193): Terminated: ok {rc=0} 10:42:33.078693 --- ParallelTerminationStrategy: PID 10196 died... 10:42:33.099448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10196): Terminated: ok {rc=0} 10:42:33.147187 --- ParallelTerminationStrategy: PID 10199 died... 10:42:33.168069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10199): Terminated: ok {rc=0} 10:42:33.258033 bus /sierra_3: Setting Powered False 10:42:34.357774 bus /sierra_3: Setting Powered False 10:42:35.475024 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:42:36.626863 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:36.639442 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:42:36.714789 tst mo_mt_call_osmux.py: using LAC 33389 10:42:36.843305 tst mo_mt_call_osmux.py: using RAC 239 10:42:36.970725 tst mo_mt_call_osmux.py: using CellId 33389 10:42:37.097514 tst mo_mt_call_osmux.py: using BVCI 33390 10:42:37.210171 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:37.221560 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:37.232630 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:37.243709 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:37.255380 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:37.267030 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:42:37.389501 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:42:37.510678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:38.018707 run create_hlr_db(pid=10202): Launched 10:42:38.144243 bus /sierra_2: Setting Powered False 10:42:39.209161 run create_hlr_db(pid=10202): Terminated: ok {rc=0} 10:42:39.646017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10204): Launched 10:42:39.953403 run osmo-hlr_10.42.42.2(pid=10205): Launched 10:42:40.070376 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:40.612515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10207): Launched 10:42:40.919231 run osmo-stp_10.42.42.5(pid=10208): Launched 10:42:41.035210 run osmo-msc_10.42.42.6: Starting osmo-msc 10:42:41.585368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10210): Launched 10:42:41.891719 run osmo-msc_10.42.42.6(pid=10211): Launched 10:42:42.064316 run osmo-stp_10.42.42.5(pid=10208): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10208)] 10:42:42.193957 run osmo-stp_10.42.42.5(pid=10208): stdout: | (launched: 2022-12-13_10:42:40.862091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:42.322075 run osmo-stp_10.42.42.5(pid=10208): stderr: | 20221213104241032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104241032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104241032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104241033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104241033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104241034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104241034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:42.449093 run osmo-stp_10.42.42.5(pid=10208): stdout: | (launched: 2022-12-13_10:42:40.862091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:42.569964 run osmo-stp_10.42.42.5(pid=10208): stderr: | 20221213104241032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104241032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104241032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104241033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104241033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104241034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104241034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:42.715040 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10208): Process ended prematurely: osmo-stp_10.42.42.5(pid=10208) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10208)] [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:42:42.723943 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:42:42.750405 run osmo-hlr_10.42.42.2(pid=10205): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10205)] 10:42:42.798350 run osmo-hlr_10.42.42.2(pid=10205): stdout: | (launched: 2022-12-13_10:42:39.895693) 10:42:42.847900 run osmo-hlr_10.42.42.2(pid=10205): stderr: | 20221213104240070 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104240070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104240070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104240070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104240070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104240070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104240082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104240090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104240091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104240091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:42.917066 run osmo-msc_10.42.42.6(pid=10211): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10211)] 10:42:42.964675 run osmo-msc_10.42.42.6(pid=10211): stdout: | (launched: 2022-12-13_10:42:41.834627) 10:42:43.014021 run osmo-msc_10.42.42.6(pid=10211): stderr: | 20221213104242107 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104242107 DLGLOBAL DEBUG validating counter group 0x7f44aceb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104242107 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104242107 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104242107 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104242107 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104242109 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104242110 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104242110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104242110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:42:43.063862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10204): Terminating (SIGTERM) 10:42:43.103310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10207): Terminating (SIGTERM) 10:42:43.142915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10210): Terminating (SIGTERM) 10:42:43.182703 --- ParallelTerminationStrategy: PID 10204 died... 10:42:43.202087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10204): Terminated: ok {rc=0} 10:42:43.246083 --- ParallelTerminationStrategy: PID 10207 died... 10:42:43.264743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10207): Terminated: ok {rc=0} 10:42:43.308579 --- ParallelTerminationStrategy: PID 10210 died... 10:42:43.327424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10210): Terminated: ok {rc=0} 10:42:43.413243 bus /sierra_3: Setting Powered False 10:42:44.512016 bus /sierra_3: Setting Powered False 10:42:45.625053 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:42:46.875359 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:42:46.882209 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:42:46.914831 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:42:46.941794 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:42:46.994607 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:42:47.027749 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:42:47.056306 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:42:47.602646 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:42:47.653491 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:47.664408 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:42:47.733516 tst mo_mt_call.py: using LAC 33390 10:42:47.855626 tst mo_mt_call.py: using RAC 240 10:42:47.978376 tst mo_mt_call.py: using CellId 33390 10:42:48.101355 tst mo_mt_call.py: using BVCI 33391 10:42:48.212536 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:48.223600 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:48.234539 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:48.245352 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:48.256177 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:48.266989 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:42:48.387789 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:42:48.507888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:48.983549 run create_hlr_db(pid=10216): Launched 10:42:49.109887 bus /sierra_2: Setting Powered False 10:42:50.174556 run create_hlr_db(pid=10216): Terminated: ok {rc=0} 10:42:50.611682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10218): Launched 10:42:50.917952 run osmo-hlr_10.42.42.2(pid=10219): Launched 10:42:51.034207 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:51.558469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10221): Launched 10:42:51.865507 run osmo-stp_10.42.42.5(pid=10222): Launched 10:42:51.981871 run osmo-msc_10.42.42.6: Starting osmo-msc 10:42:52.533529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10224): Launched 10:42:52.838913 run osmo-msc_10.42.42.6(pid=10225): Launched 10:42:53.008911 run osmo-stp_10.42.42.5(pid=10222): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10222)] 10:42:53.137792 run osmo-stp_10.42.42.5(pid=10222): stdout: | (launched: 2022-12-13_10:42:51.808502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:53.266428 run osmo-stp_10.42.42.5(pid=10222): stderr: | 20221213104251977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104251977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104251977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104251978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104251978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104251978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104251978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:53.393152 run osmo-stp_10.42.42.5(pid=10222): stdout: | (launched: 2022-12-13_10:42:51.808502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:53.514609 run osmo-stp_10.42.42.5(pid=10222): stderr: | 20221213104251977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104251977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104251977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104251978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104251978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104251978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104251978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:53.659641 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10222): Process ended prematurely: osmo-stp_10.42.42.5(pid=10222) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10222)] [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:42:53.668518 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:42:53.694880 run osmo-hlr_10.42.42.2(pid=10219): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10219)] 10:42:53.742546 run osmo-hlr_10.42.42.2(pid=10219): stdout: | (launched: 2022-12-13_10:42:50.861208) 10:42:53.791873 run osmo-hlr_10.42.42.2(pid=10219): stderr: | 20221213104251037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104251037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104251037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104251037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104251037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104251037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104251049 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104251058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104251058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104251058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:53.860752 run osmo-msc_10.42.42.6(pid=10225): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10225)] 10:42:53.908587 run osmo-msc_10.42.42.6(pid=10225): stdout: | (launched: 2022-12-13_10:42:52.782145) 10:42:53.958185 run osmo-msc_10.42.42.6(pid=10225): stderr: | 20221213104253051 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104253052 DLGLOBAL DEBUG validating counter group 0x7f51b6160c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104253052 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104253052 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104253052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104253052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104253054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104253054 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104253055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104253055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:42:54.008012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10218): Terminating (SIGTERM) 10:42:54.047825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10221): Terminating (SIGTERM) 10:42:54.088350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10224): Terminating (SIGTERM) 10:42:54.128460 --- ParallelTerminationStrategy: PID 10218 died... 10:42:54.147654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10218): Terminated: ok {rc=0} 10:42:54.191701 --- ParallelTerminationStrategy: PID 10221 died... 10:42:54.210362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10221): Terminated: ok {rc=0} 10:42:54.254377 --- ParallelTerminationStrategy: PID 10224 died... 10:42:54.273007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10224): Terminated: ok {rc=0} 10:42:54.359114 bus /sierra_3: Setting Powered False 10:42:55.459436 bus /sierra_3: Setting Powered False 10:42:56.575301 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:42:57.721557 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:57.733069 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:42:57.800763 tst mo_mt_call_osmux.py: using LAC 33391 10:42:57.921283 tst mo_mt_call_osmux.py: using RAC 241 10:42:58.040770 tst mo_mt_call_osmux.py: using CellId 33391 10:42:58.170775 tst mo_mt_call_osmux.py: using BVCI 33392 10:42:58.291316 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:58.303195 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:58.314849 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:58.326409 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:58.338555 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:58.350671 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:42:58.467304 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:42:58.589774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:59.097577 run create_hlr_db(pid=10227): Launched 10:42:59.223300 bus /sierra_2: Setting Powered False 10:43:00.288038 run create_hlr_db(pid=10227): Terminated: ok {rc=0} 10:43:00.744752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10229): Launched 10:43:01.097898 run osmo-hlr_10.42.42.2(pid=10230): Launched 10:43:01.348837 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:02.024126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10232): Launched 10:43:02.349221 run osmo-stp_10.42.42.5(pid=10233): Launched 10:43:02.465907 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:03.016463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10235): Launched 10:43:03.321934 run osmo-msc_10.42.42.6(pid=10236): Launched 10:43:03.491613 run osmo-stp_10.42.42.5(pid=10233): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10233)] 10:43:03.620291 run osmo-stp_10.42.42.5(pid=10233): stdout: | (launched: 2022-12-13_10:43:02.291031) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:03.748672 run osmo-stp_10.42.42.5(pid=10233): stderr: | 20221213104302459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104302459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104302460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104302460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104302461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104302461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104302461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:03.875829 run osmo-stp_10.42.42.5(pid=10233): stdout: | (launched: 2022-12-13_10:43:02.291031) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:03.996584 run osmo-stp_10.42.42.5(pid=10233): stderr: | 20221213104302459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104302459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104302460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104302460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104302461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104302461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104302461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:04.142136 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10233): Process ended prematurely: osmo-stp_10.42.42.5(pid=10233) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10233)] [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:43:04.151047 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:43:04.177697 run osmo-hlr_10.42.42.2(pid=10230): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10230)] 10:43:04.225549 run osmo-hlr_10.42.42.2(pid=10230): stdout: | (launched: 2022-12-13_10:43:01.039111) 10:43:04.275238 run osmo-hlr_10.42.42.2(pid=10230): stderr: | 20221213104301331 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104301331 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104301331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104301331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104301331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104301331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104301355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104301367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104301368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104301368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:04.345119 run osmo-msc_10.42.42.6(pid=10236): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10236)] 10:43:04.392712 run osmo-msc_10.42.42.6(pid=10236): stdout: | (launched: 2022-12-13_10:43:03.265056) 10:43:04.441915 run osmo-msc_10.42.42.6(pid=10236): stderr: | 20221213104303535 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104303535 DLGLOBAL DEBUG validating counter group 0x7f5bdfb26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104303535 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104303535 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104303535 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104303535 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104303537 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104303537 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104303538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104303538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:04.491395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10229): Terminating (SIGTERM) 10:43:04.530854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10232): Terminating (SIGTERM) 10:43:04.570211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10235): Terminating (SIGTERM) 10:43:04.609924 --- ParallelTerminationStrategy: PID 10229 died... 10:43:04.629232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10229): Terminated: ok {rc=0} 10:43:04.673040 --- ParallelTerminationStrategy: PID 10232 died... 10:43:04.691586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10232): Terminated: ok {rc=0} 10:43:04.735173 --- ParallelTerminationStrategy: PID 10235 died... 10:43:04.753847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10235): Terminated: ok {rc=0} 10:43:04.839655 bus /sierra_3: Setting Powered False 10:43:05.939209 bus /sierra_3: Setting Powered False 10:43:07.055023 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:43:08.302434 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:08.309313 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:43:08.341670 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:43:08.368321 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:43:08.419412 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:43:08.451496 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:43:08.477826 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:43:09.032341 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:43:09.085586 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:09.097253 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:43:09.168819 tst mo_mt_call.py: using LAC 33392 10:43:09.302108 tst mo_mt_call.py: using RAC 242 10:43:09.430246 tst mo_mt_call.py: using CellId 33392 10:43:09.556202 tst mo_mt_call.py: using BVCI 33393 10:43:09.675265 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:09.686778 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:09.698122 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:09.709499 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:09.721193 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:09.732616 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:43:09.850039 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:43:09.967981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:10.441917 run create_hlr_db(pid=10241): Launched 10:43:10.567890 bus /sierra_2: Setting Powered False 10:43:11.629453 run create_hlr_db(pid=10241): Terminated: ok {rc=0} 10:43:12.055995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10243): Launched 10:43:12.362903 run osmo-hlr_10.42.42.2(pid=10244): Launched 10:43:12.478034 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:13.001687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10246): Launched 10:43:13.307103 run osmo-stp_10.42.42.5(pid=10247): Launched 10:43:13.424874 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:13.975008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10249): Launched 10:43:14.281690 run osmo-msc_10.42.42.6(pid=10250): Launched 10:43:14.452624 run osmo-stp_10.42.42.5(pid=10247): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10247)] 10:43:14.581387 run osmo-stp_10.42.42.5(pid=10247): stdout: | (launched: 2022-12-13_10:43:13.250021) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:14.710283 run osmo-stp_10.42.42.5(pid=10247): stderr: | 20221213104313418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104313418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104313418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104313418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104313419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104313419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104313419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:14.837192 run osmo-stp_10.42.42.5(pid=10247): stdout: | (launched: 2022-12-13_10:43:13.250021) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:14.958793 run osmo-stp_10.42.42.5(pid=10247): stderr: | 20221213104313418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104313418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104313418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104313418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104313419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104313419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104313419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:15.103796 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10247): Process ended prematurely: osmo-stp_10.42.42.5(pid=10247) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10247)] [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:43:15.112622 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:43:15.139173 run osmo-hlr_10.42.42.2(pid=10244): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10244)] 10:43:15.187385 run osmo-hlr_10.42.42.2(pid=10244): stdout: | (launched: 2022-12-13_10:43:12.306138) 10:43:15.237449 run osmo-hlr_10.42.42.2(pid=10244): stderr: | 20221213104312480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104312480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104312480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104312480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104312480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104312480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104312514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104312525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104312525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104312525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:15.307086 run osmo-msc_10.42.42.6(pid=10250): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10250)] 10:43:15.355317 run osmo-msc_10.42.42.6(pid=10250): stdout: | (launched: 2022-12-13_10:43:14.224374) 10:43:15.405262 run osmo-msc_10.42.42.6(pid=10250): stderr: | 20221213104314495 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104314495 DLGLOBAL DEBUG validating counter group 0x7f0e024c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104314495 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104314495 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104314495 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104314495 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104314497 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104314497 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104314498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104314498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:15.455374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10243): Terminating (SIGTERM) 10:43:15.495388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10246): Terminating (SIGTERM) 10:43:15.535368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10249): Terminating (SIGTERM) 10:43:15.575586 --- ParallelTerminationStrategy: PID 10243 died... 10:43:15.594916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10243): Terminated: ok {rc=0} 10:43:15.639193 --- ParallelTerminationStrategy: PID 10246 died... 10:43:15.658011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10246): Terminated: ok {rc=0} 10:43:15.702142 --- ParallelTerminationStrategy: PID 10249 died... 10:43:15.720916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10249): Terminated: ok {rc=0} 10:43:15.805618 bus /sierra_3: Setting Powered False 10:43:16.906456 bus /sierra_3: Setting Powered False 10:43:18.044753 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:43:19.196810 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:19.209268 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:43:19.280257 tst mo_mt_call_osmux.py: using LAC 33393 10:43:19.407835 tst mo_mt_call_osmux.py: using RAC 243 10:43:19.535330 tst mo_mt_call_osmux.py: using CellId 33393 10:43:19.663061 tst mo_mt_call_osmux.py: using BVCI 33394 10:43:19.783507 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:19.795080 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:19.806482 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:19.817917 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:19.829678 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:19.841287 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:43:19.958207 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:43:20.078909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:20.587452 run create_hlr_db(pid=10252): Launched 10:43:20.712732 bus /sierra_2: Setting Powered False 10:43:21.777948 run create_hlr_db(pid=10252): Terminated: ok {rc=0} 10:43:22.234803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10254): Launched 10:43:22.563496 run osmo-hlr_10.42.42.2(pid=10255): Launched 10:43:22.690372 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:23.257434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10257): Launched 10:43:23.584869 run osmo-stp_10.42.42.5(pid=10258): Launched 10:43:23.711401 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:24.304068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10260): Launched 10:43:24.634150 run osmo-msc_10.42.42.6(pid=10261): Launched 10:43:24.818366 run osmo-stp_10.42.42.5(pid=10258): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10258)] 10:43:24.956295 run osmo-stp_10.42.42.5(pid=10258): stdout: | (launched: 2022-12-13_10:43:23.524369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:25.095464 run osmo-stp_10.42.42.5(pid=10258): stderr: | 20221213104323716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104323716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104323716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104323717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104323717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104323717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104323717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:25.232091 run osmo-stp_10.42.42.5(pid=10258): stdout: | (launched: 2022-12-13_10:43:23.524369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:25.362502 run osmo-stp_10.42.42.5(pid=10258): stderr: | 20221213104323716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104323716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104323716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104323717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104323717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104323717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104323717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:25.518246 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10258): Process ended prematurely: osmo-stp_10.42.42.5(pid=10258) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10258)] [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:43:25.527866 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:43:25.555805 run osmo-hlr_10.42.42.2(pid=10255): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10255)] 10:43:25.606993 run osmo-hlr_10.42.42.2(pid=10255): stdout: | (launched: 2022-12-13_10:43:22.502885) 10:43:25.659313 run osmo-hlr_10.42.42.2(pid=10255): stderr: | 20221213104322699 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104322699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104322699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104322699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104322699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104322699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104322713 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104322721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104322721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104322721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:25.732519 run osmo-msc_10.42.42.6(pid=10261): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10261)] 10:43:25.782948 run osmo-msc_10.42.42.6(pid=10261): stdout: | (launched: 2022-12-13_10:43:24.573461) 10:43:25.835305 run osmo-msc_10.42.42.6(pid=10261): stderr: | 20221213104324896 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104324896 DLGLOBAL DEBUG validating counter group 0x7f5d52c0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104324896 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104324896 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104324896 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104324897 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104324898 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104324899 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104324899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104324899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:25.887762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10254): Terminating (SIGTERM) 10:43:25.930700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10257): Terminating (SIGTERM) 10:43:25.972919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10260): Terminating (SIGTERM) 10:43:26.015572 --- ParallelTerminationStrategy: PID 10254 died... 10:43:26.036178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10254): Terminated: ok {rc=0} 10:43:26.083098 --- ParallelTerminationStrategy: PID 10257 died... 10:43:26.103176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10257): Terminated: ok {rc=0} 10:43:26.149724 --- ParallelTerminationStrategy: PID 10260 died... 10:43:26.169775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10260): Terminated: ok {rc=0} 10:43:26.259306 bus /sierra_3: Setting Powered False 10:43:27.359867 bus /sierra_3: Setting Powered False 10:43:28.477658 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:43:29.730461 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:29.737108 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:43:29.768776 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:43:29.795065 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:43:29.845732 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:43:29.877203 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:43:29.903094 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:43:30.454485 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:43:30.503736 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:30.515071 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:43:30.582453 tst mo_mt_call.py: using LAC 33394 10:43:30.702466 tst mo_mt_call.py: using RAC 244 10:43:30.823881 tst mo_mt_call.py: using CellId 33394 10:43:30.962277 tst mo_mt_call.py: using BVCI 33395 10:43:31.092037 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:31.104715 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:31.117288 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:31.129834 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:31.143539 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:31.158766 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:43:31.283846 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:43:31.411092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:31.937124 run create_hlr_db(pid=10266): Launched 10:43:32.101908 bus /sierra_2: Setting Powered False 10:43:33.166947 run create_hlr_db(pid=10266): Terminated: ok {rc=0} 10:43:33.625503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10268): Launched 10:43:33.955266 run osmo-hlr_10.42.42.2(pid=10269): Launched 10:43:34.080416 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:34.644895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10271): Launched 10:43:34.974274 run osmo-stp_10.42.42.5(pid=10272): Launched 10:43:35.100353 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:35.691618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10274): Launched 10:43:36.021646 run osmo-msc_10.42.42.6(pid=10275): Launched 10:43:36.205287 run osmo-stp_10.42.42.5(pid=10272): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10272)] 10:43:36.344138 run osmo-stp_10.42.42.5(pid=10272): stdout: | (launched: 2022-12-13_10:43:34.913825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:36.484221 run osmo-stp_10.42.42.5(pid=10272): stderr: | 20221213104335104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104335104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104335104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104335105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104335105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104335105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104335105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:36.621259 run osmo-stp_10.42.42.5(pid=10272): stdout: | (launched: 2022-12-13_10:43:34.913825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:36.751472 run osmo-stp_10.42.42.5(pid=10272): stderr: | 20221213104335104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104335104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104335104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104335105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104335105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104335105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104335105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:36.907601 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10272): Process ended prematurely: osmo-stp_10.42.42.5(pid=10272) [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10272)] [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:43:36.917545 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:43:36.945528 run osmo-hlr_10.42.42.2(pid=10269): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10269)] 10:43:36.996772 run osmo-hlr_10.42.42.2(pid=10269): stdout: | (launched: 2022-12-13_10:43:33.894867) 10:43:37.049701 run osmo-hlr_10.42.42.2(pid=10269): stderr: | 20221213104334090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104334090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104334090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104334090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104334090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104334090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104334102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104334111 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104334111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104334112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:37.122506 run osmo-msc_10.42.42.6(pid=10275): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10275)] 10:43:37.172921 run osmo-msc_10.42.42.6(pid=10275): stdout: | (launched: 2022-12-13_10:43:35.960864) 10:43:37.225245 run osmo-msc_10.42.42.6(pid=10275): stderr: | 20221213104336280 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104336280 DLGLOBAL DEBUG validating counter group 0x7f8d3cbaac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104336280 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104336280 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104336280 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104336280 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104336282 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104336282 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104336283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104336283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:37.277740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10268): Terminating (SIGTERM) 10:43:37.319741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10271): Terminating (SIGTERM) 10:43:37.362128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10274): Terminating (SIGTERM) 10:43:37.404605 --- ParallelTerminationStrategy: PID 10268 died... 10:43:37.425521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10268): Terminated: ok {rc=0} 10:43:37.472286 --- ParallelTerminationStrategy: PID 10271 died... 10:43:37.492345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10271): Terminated: ok {rc=0} 10:43:37.539145 --- ParallelTerminationStrategy: PID 10274 died... 10:43:37.559152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10274): Terminated: ok {rc=0} 10:43:37.647420 bus /sierra_3: Setting Powered False 10:43:38.748771 bus /sierra_3: Setting Powered False 10:43:39.865768 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:43:41.017054 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:41.029502 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:43:41.101509 tst mo_mt_call_osmux.py: using LAC 33395 10:43:41.235580 tst mo_mt_call_osmux.py: using RAC 245 10:43:41.363480 tst mo_mt_call_osmux.py: using CellId 33395 10:43:41.493911 tst mo_mt_call_osmux.py: using BVCI 33396 10:43:41.614437 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:41.626102 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:41.637738 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:41.649155 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:41.661086 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:41.672789 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:43:41.790881 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:43:41.913357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:42.391029 run create_hlr_db(pid=10277): Launched 10:43:42.516017 bus /sierra_2: Setting Powered False 10:43:43.576294 run create_hlr_db(pid=10277): Terminated: ok {rc=0} 10:43:44.027070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10279): Launched 10:43:44.357514 run osmo-hlr_10.42.42.2(pid=10280): Launched 10:43:44.482391 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:45.046214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10282): Launched 10:43:45.374802 run osmo-stp_10.42.42.5(pid=10283): Launched 10:43:45.500707 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:46.113215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10285): Launched 10:43:46.441357 run osmo-msc_10.42.42.6(pid=10286): Launched 10:43:46.827886 run osmo-stp_10.42.42.5(pid=10283): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10283)] 10:43:47.160201 run osmo-stp_10.42.42.5(pid=10283): stdout: | (launched: 2022-12-13_10:43:45.314026) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:47.314445 run osmo-stp_10.42.42.5(pid=10283): stderr: | 20221213104345503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104345503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104345503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104345503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104345504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104345504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104345504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:47.442944 run osmo-stp_10.42.42.5(pid=10283): stdout: | (launched: 2022-12-13_10:43:45.314026) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:47.565166 run osmo-stp_10.42.42.5(pid=10283): stderr: | 20221213104345503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104345503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104345503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104345503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104345504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104345504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104345504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:47.711867 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10283): Process ended prematurely: osmo-stp_10.42.42.5(pid=10283) [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10283)] [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:43:47.721302 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 10:43:47.748096 run osmo-hlr_10.42.42.2(pid=10280): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10280)] 10:43:47.796380 run osmo-hlr_10.42.42.2(pid=10280): stdout: | (launched: 2022-12-13_10:43:44.297144) 10:43:47.846431 run osmo-hlr_10.42.42.2(pid=10280): stderr: | 20221213104344493 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104344493 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104344493 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104344493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104344493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104344493 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104344506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104344514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104344515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104344515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:47.916322 run osmo-msc_10.42.42.6(pid=10286): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10286)] 10:43:47.964669 run osmo-msc_10.42.42.6(pid=10286): stdout: | (launched: 2022-12-13_10:43:46.383019) 10:43:48.014728 run osmo-msc_10.42.42.6(pid=10286): stderr: | 20221213104346881 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104346881 DLGLOBAL DEBUG validating counter group 0x7fb886d03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104346881 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104346881 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104346882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104346882 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104346883 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104346884 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104346884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104346884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:48.064739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10279): Terminating (SIGTERM) 10:43:48.105398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10282): Terminating (SIGTERM) 10:43:48.145781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10285): Terminating (SIGTERM) 10:43:48.187020 --- ParallelTerminationStrategy: PID 10279 died... 10:43:48.206687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10279): Terminated: ok {rc=0} 10:43:48.251773 --- ParallelTerminationStrategy: PID 10282 died... 10:43:48.270837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10282): Terminated: ok {rc=0} 10:43:48.315508 --- ParallelTerminationStrategy: PID 10285 died... 10:43:48.334544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10285): Terminated: ok {rc=0} 10:43:48.421159 bus /sierra_3: Setting Powered False 10:43:49.523900 bus /sierra_3: Setting Powered False 10:43:50.643213 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:43:51.897859 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:51.904191 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:43:51.936291 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:43:51.962783 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:43:52.015864 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:43:52.049525 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:43:52.077190 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:43:52.624430 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:43:52.675529 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:52.686554 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:43:52.757192 tst mo_mt_call.py: using LAC 33396 10:43:52.876505 tst mo_mt_call.py: using RAC 246 10:43:52.994152 tst mo_mt_call.py: using CellId 33396 10:43:53.114553 tst mo_mt_call.py: using BVCI 33397 10:43:53.226571 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:53.237385 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:53.248031 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:53.258618 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:53.269208 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:53.279786 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:43:53.399878 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:43:53.517560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:53.992320 run create_hlr_db(pid=10291): Launched 10:43:54.117130 bus /sierra_2: Setting Powered False 10:43:55.178512 run create_hlr_db(pid=10291): Terminated: ok {rc=0} 10:43:55.626867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10293): Launched 10:43:55.938318 run osmo-hlr_10.42.42.2(pid=10294): Launched 10:43:56.053783 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:56.579015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10296): Launched 10:43:56.886907 run osmo-stp_10.42.42.5(pid=10297): Launched 10:43:57.002263 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:57.552768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10299): Launched 10:43:57.859922 run osmo-msc_10.42.42.6(pid=10300): Launched 10:43:58.032114 run osmo-stp_10.42.42.5(pid=10297): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10297)] 10:43:58.160667 run osmo-stp_10.42.42.5(pid=10297): stdout: | (launched: 2022-12-13_10:43:56.829933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:58.289295 run osmo-stp_10.42.42.5(pid=10297): stderr: | 20221213104356999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104356999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104357000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104357000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104357001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104357001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104357001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:58.416523 run osmo-stp_10.42.42.5(pid=10297): stdout: | (launched: 2022-12-13_10:43:56.829933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:58.538243 run osmo-stp_10.42.42.5(pid=10297): stderr: | 20221213104356999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104356999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104357000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104357000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104357001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104357001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104357001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:58.684812 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10297): Process ended prematurely: osmo-stp_10.42.42.5(pid=10297) [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10297)] [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:43:58.694034 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:43:58.720521 run osmo-hlr_10.42.42.2(pid=10294): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10294)] 10:43:58.768518 run osmo-hlr_10.42.42.2(pid=10294): stdout: | (launched: 2022-12-13_10:43:55.881298) 10:43:58.818145 run osmo-hlr_10.42.42.2(pid=10294): stderr: | 20221213104356056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104356056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104356056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104356056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104356056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104356056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104356072 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104356082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104356082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104356082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:58.887410 run osmo-msc_10.42.42.6(pid=10300): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10300)] 10:43:58.935438 run osmo-msc_10.42.42.6(pid=10300): stdout: | (launched: 2022-12-13_10:43:57.802767) 10:43:58.985130 run osmo-msc_10.42.42.6(pid=10300): stderr: | 20221213104358075 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104358075 DLGLOBAL DEBUG validating counter group 0x7f40e3cc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104358075 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104358075 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104358076 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104358076 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104358078 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104358078 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104358078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104358078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:59.034754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10293): Terminating (SIGTERM) 10:43:59.074542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10296): Terminating (SIGTERM) 10:43:59.114343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10299): Terminating (SIGTERM) 10:43:59.155344 --- ParallelTerminationStrategy: PID 10293 died... 10:43:59.174798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10293): Terminated: ok {rc=0} 10:43:59.219128 --- ParallelTerminationStrategy: PID 10296 died... 10:43:59.238111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10296): Terminated: ok {rc=0} 10:43:59.282166 --- ParallelTerminationStrategy: PID 10299 died... 10:43:59.301201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10299): Terminated: ok {rc=0} 10:43:59.387960 bus /sierra_3: Setting Powered False 10:44:00.490157 bus /sierra_3: Setting Powered False 10:44:01.614948 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:44:02.782876 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:44:02.794874 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:44:02.867006 tst mo_mt_call_osmux.py: using LAC 33397 10:44:02.996639 tst mo_mt_call_osmux.py: using RAC 247 10:44:03.125063 tst mo_mt_call_osmux.py: using CellId 33397 10:44:03.256309 tst mo_mt_call_osmux.py: using BVCI 33398 10:44:03.376264 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:44:03.387675 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:44:03.398879 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:44:03.410046 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:44:03.421485 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:44:03.433082 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:44:03.551684 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:44:03.671665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:04.182472 run create_hlr_db(pid=10302): Launched 10:44:04.307481 bus /sierra_2: Setting Powered False 10:44:05.372124 run create_hlr_db(pid=10302): Terminated: ok {rc=0} 10:44:05.811314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10304): Launched 10:44:06.119609 run osmo-hlr_10.42.42.2(pid=10305): Launched 10:44:06.235240 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:06.762050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10307): Launched 10:44:07.069963 run osmo-stp_10.42.42.5(pid=10308): Launched 10:44:07.188209 run osmo-msc_10.42.42.6: Starting osmo-msc 10:44:07.748380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10310): Launched 10:44:08.059930 run osmo-msc_10.42.42.6(pid=10311): Launched 10:44:08.231016 run osmo-stp_10.42.42.5(pid=10308): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10308)] 10:44:08.360645 run osmo-stp_10.42.42.5(pid=10308): stdout: | (launched: 2022-12-13_10:44:07.012566) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:08.489803 run osmo-stp_10.42.42.5(pid=10308): stderr: | 20221213104407179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104407180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104407180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104407180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104407181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104407181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104407181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:08.617664 run osmo-stp_10.42.42.5(pid=10308): stdout: | (launched: 2022-12-13_10:44:07.012566) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:08.740740 run osmo-stp_10.42.42.5(pid=10308): stderr: | 20221213104407179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104407180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104407180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104407180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104407181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104407181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104407181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:08.887719 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10308): Process ended prematurely: osmo-stp_10.42.42.5(pid=10308) [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10308)] [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:44:08.896701 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:44:08.923567 run osmo-hlr_10.42.42.2(pid=10305): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10305)] 10:44:08.971936 run osmo-hlr_10.42.42.2(pid=10305): stdout: | (launched: 2022-12-13_10:44:06.062575) 10:44:09.021901 run osmo-hlr_10.42.42.2(pid=10305): stderr: | 20221213104406238 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104406238 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104406238 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104406238 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104406238 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104406238 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104406251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104406260 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104406260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104406260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:09.091904 run osmo-msc_10.42.42.6(pid=10311): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10311)] 10:44:09.140411 run osmo-msc_10.42.42.6(pid=10311): stdout: | (launched: 2022-12-13_10:44:08.002301) 10:44:09.190464 run osmo-msc_10.42.42.6(pid=10311): stderr: | 20221213104408274 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104408274 DLGLOBAL DEBUG validating counter group 0x7f0ee829ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104408274 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104408274 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104408274 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104408275 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104408276 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104408277 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104408277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104408277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:44:09.241170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10304): Terminating (SIGTERM) 10:44:09.281241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10307): Terminating (SIGTERM) 10:44:09.321400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10310): Terminating (SIGTERM) 10:44:09.362574 --- ParallelTerminationStrategy: PID 10304 died... 10:44:09.382269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10304): Terminated: ok {rc=0} 10:44:09.426962 --- ParallelTerminationStrategy: PID 10307 died... 10:44:09.445863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10307): Terminated: ok {rc=0} 10:44:09.490840 --- ParallelTerminationStrategy: PID 10310 died... 10:44:09.509926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10310): Terminated: ok {rc=0} 10:44:09.596813 bus /sierra_3: Setting Powered False 10:44:10.697745 bus /sierra_3: Setting Powered False 10:44:11.815088 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:44:13.064433 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:44:13.072894 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:44:13.106707 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 10:44:13.134056 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 10:44:13.190081 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:44:13.223538 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 10:44:13.250877 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 10:44:13.795859 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 10:44:13.845891 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:44:13.857244 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:44:13.911652 tst mo_mt_call.py: using LAC 33398 10:44:14.031417 tst mo_mt_call.py: using RAC 248 10:44:14.150952 tst mo_mt_call.py: using CellId 33398 10:44:14.269833 tst mo_mt_call.py: using BVCI 33399 10:44:14.380431 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:44:14.391615 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:44:14.402625 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:44:14.413553 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:44:14.424557 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:44:14.435504 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:44:14.557826 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:44:14.675125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:15.150856 run create_hlr_db(pid=10317): Launched 10:44:15.275784 bus /sierra_2: Setting Powered False 10:44:16.360874 run create_hlr_db(pid=10317): Terminated: ok {rc=0} 10:44:16.868499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10320): Launched 10:44:17.187686 run osmo-hlr_10.42.42.2(pid=10321): Launched 10:44:17.355720 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:17.896668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10323): Launched 10:44:18.203174 run osmo-stp_10.42.42.5(pid=10324): Launched 10:44:18.321066 run osmo-msc_10.42.42.6: Starting osmo-msc 10:44:18.874468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10326): Launched 10:44:19.182299 run osmo-msc_10.42.42.6(pid=10327): Launched 10:44:19.353474 run osmo-stp_10.42.42.5(pid=10324): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10324)] 10:44:19.481641 run osmo-stp_10.42.42.5(pid=10324): stdout: | (launched: 2022-12-13_10:44:18.146219) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:19.610292 run osmo-stp_10.42.42.5(pid=10324): stderr: | 20221213104418313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104418313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104418313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104418314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104418314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104418314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104418314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:19.737281 run osmo-stp_10.42.42.5(pid=10324): stdout: | (launched: 2022-12-13_10:44:18.146219) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:19.858570 run osmo-stp_10.42.42.5(pid=10324): stderr: | 20221213104418313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104418313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104418313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104418314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104418314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104418314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104418314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:20.003780 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10324): Process ended prematurely: osmo-stp_10.42.42.5(pid=10324) [trial-2388↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10324)] [trial-2388↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 10:44:20.012828 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:44:20.039468 run osmo-hlr_10.42.42.2(pid=10321): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10321)] 10:44:20.087669 run osmo-hlr_10.42.42.2(pid=10321): stdout: | (launched: 2022-12-13_10:44:17.130495) 10:44:20.137415 run osmo-hlr_10.42.42.2(pid=10321): stderr: | 20221213104417338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104417338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104417338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104417338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104417338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104417338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104417351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104417359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104417359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104417359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:20.206912 run osmo-msc_10.42.42.6(pid=10327): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10327)] 10:44:20.254727 run osmo-msc_10.42.42.6(pid=10327): stdout: | (launched: 2022-12-13_10:44:19.125233) 10:44:20.303985 run osmo-msc_10.42.42.6(pid=10327): stderr: | 20221213104419395 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104419396 DLGLOBAL DEBUG validating counter group 0x7f263626ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104419396 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104419396 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104419396 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104419396 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104419398 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104419398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104419399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104419399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:44:20.353785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10320): Terminating (SIGTERM) 10:44:20.393817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10323): Terminating (SIGTERM) 10:44:20.433600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10326): Terminating (SIGTERM) 10:44:20.473635 --- ParallelTerminationStrategy: PID 10320 died... 10:44:20.493076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10320): Terminated: ok {rc=0} 10:44:20.537178 --- ParallelTerminationStrategy: PID 10323 died... 10:44:20.555777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10323): Terminated: ok {rc=0} 10:44:20.599943 --- ParallelTerminationStrategy: PID 10326 died... 10:44:20.618608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10326): Terminated: ok {rc=0} 10:44:20.704671 bus /sierra_3: Setting Powered False 10:44:21.805836 bus /sierra_3: Setting Powered False 10:44:22.920493 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 10:44:24.072229 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:44:24.084590 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:44:24.138786 tst mo_mt_call_osmux.py: using LAC 33399 10:44:24.268108 tst mo_mt_call_osmux.py: using RAC 249 10:44:24.395707 tst mo_mt_call_osmux.py: using CellId 33399 10:44:24.523693 tst mo_mt_call_osmux.py: using BVCI 33400 10:44:24.642760 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:44:24.654503 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:44:24.666104 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:44:24.677677 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:44:24.689626 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:44:24.701412 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:44:24.820572 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:44:24.942872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:25.454025 run create_hlr_db(pid=10329): Launched 10:44:25.580241 bus /sierra_2: Setting Powered False 10:44:26.645788 run create_hlr_db(pid=10329): Terminated: ok {rc=0} 10:44:27.083402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10331): Launched 10:44:27.390177 run osmo-hlr_10.42.42.2(pid=10332): Launched 10:44:27.507273 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:28.035938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10334): Launched 10:44:28.344653 run osmo-stp_10.42.42.5(pid=10335): Launched 10:44:28.461904 run osmo-msc_10.42.42.6: Starting osmo-msc 10:44:29.018507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10337): Launched 10:44:29.326850 run osmo-msc_10.42.42.6(pid=10338): Launched 10:44:29.500284 run osmo-stp_10.42.42.5(pid=10335): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10335)] 10:44:29.629598 run osmo-stp_10.42.42.5(pid=10335): stdout: | (launched: 2022-12-13_10:44:28.287216) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:29.759080 run osmo-stp_10.42.42.5(pid=10335): stderr: | 20221213104428455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104428456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104428456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104428456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104428457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104428457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104428457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:29.886760 run osmo-stp_10.42.42.5(pid=10335): stdout: | (launched: 2022-12-13_10:44:28.287216) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:30.008591 run osmo-stp_10.42.42.5(pid=10335): stderr: | 20221213104428455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104428456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104428456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104428456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104428457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104428457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104428457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:30.155286 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10335): Process ended prematurely: osmo-stp_10.42.42.5(pid=10335) [trial-2388↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10335)] [trial-2388↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 10:44:30.164488 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:44:30.190907 run osmo-hlr_10.42.42.2(pid=10332): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10332)] 10:44:30.239092 run osmo-hlr_10.42.42.2(pid=10332): stdout: | (launched: 2022-12-13_10:44:27.332750) 10:44:30.289636 run osmo-hlr_10.42.42.2(pid=10332): stderr: | 20221213104427507 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104427507 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104427507 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104427507 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104427507 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104427507 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104427519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104427527 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104427528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104427528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:30.359015 run osmo-msc_10.42.42.6(pid=10338): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10338)] 10:44:30.406651 run osmo-msc_10.42.42.6(pid=10338): stdout: | (launched: 2022-12-13_10:44:29.269496) 10:44:30.456218 run osmo-msc_10.42.42.6(pid=10338): stderr: | 20221213104429538 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104429538 DLGLOBAL DEBUG validating counter group 0x7f36333f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104429539 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104429539 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104429539 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104429539 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104429541 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104429541 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104429541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104429541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:44:30.506352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10331): Terminating (SIGTERM) 10:44:30.546465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10334): Terminating (SIGTERM) 10:44:30.586500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10337): Terminating (SIGTERM) 10:44:30.626798 --- ParallelTerminationStrategy: PID 10331 died... 10:44:30.646204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10331): Terminated: ok {rc=0} 10:44:30.690470 --- ParallelTerminationStrategy: PID 10334 died... 10:44:30.709485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10334): Terminated: ok {rc=0} 10:44:30.753440 --- ParallelTerminationStrategy: PID 10337 died... 10:44:30.772245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10337): Terminated: ok {rc=0} 10:44:30.859752 bus /sierra_3: Setting Powered False 10:44:31.976623 bus /sierra_3: Setting Powered False 10:44:33.099821 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 emergency:trx-umtrx --------------------------------------------------------------------- 10:44:34.352902 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:44:34.358352 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:44:34.390883 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 10:44:34.418288 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 10:44:34.502223 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:44:34.534171 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 10:44:34.560585 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 10:44:35.141421 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2388 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 10:44:35.146649 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:44:35.157422 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 10:44:35.204489 tst emergency_mo_mt_call.py: using LAC 33400 10:44:35.322600 tst emergency_mo_mt_call.py: using RAC 250 10:44:35.442208 tst emergency_mo_mt_call.py: using CellId 33400 10:44:35.559852 tst emergency_mo_mt_call.py: using BVCI 33401 10:44:35.669808 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:44:35.680649 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:44:35.691277 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:44:35.701871 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:44:35.712591 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:44:35.723260 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:44:35.838139 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:44:35.959230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:36.463233 run create_hlr_db(pid=10344): Launched 10:44:36.587107 bus /sierra_2: Setting Powered False 10:44:37.651039 run create_hlr_db(pid=10344): Terminated: ok {rc=0} 10:44:38.104006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10346): Launched 10:44:38.429107 run osmo-hlr_10.42.42.2(pid=10347): Launched 10:44:38.554472 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:39.114139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10349): Launched 10:44:39.422223 run osmo-stp_10.42.42.5(pid=10350): Launched 10:44:39.547570 tst emergency_mo_mt_call.py: using MSISDN 8113 10:44:39.713052 run osmo-msc_10.42.42.6: Starting osmo-msc 10:44:40.255717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10352): Launched 10:44:40.558638 run osmo-msc_10.42.42.6(pid=10353): Launched 10:44:40.728017 run osmo-stp_10.42.42.5(pid=10350): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10350)] 10:44:40.858206 run osmo-stp_10.42.42.5(pid=10350): stdout: | (launched: 2022-12-13_10:44:39.366083) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:40.986823 run osmo-stp_10.42.42.5(pid=10350): stderr: | 20221213104439533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104439533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104439533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104439534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104439534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104439534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104439534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:41.112692 run osmo-stp_10.42.42.5(pid=10350): stdout: | (launched: 2022-12-13_10:44:39.366083) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:41.232850 run osmo-stp_10.42.42.5(pid=10350): stderr: | 20221213104439533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104439533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104439533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104439534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104439534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104439534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104439534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:41.376484 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10350): Process ended prematurely: osmo-stp_10.42.42.5(pid=10350) [trial-2388↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10350)] [trial-2388↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 10:44:41.385064 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 10:44:41.411205 run osmo-hlr_10.42.42.2(pid=10347): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10347)] 10:44:41.459719 run osmo-hlr_10.42.42.2(pid=10347): stdout: | (launched: 2022-12-13_10:44:38.369313) 10:44:41.509887 run osmo-hlr_10.42.42.2(pid=10347): stderr: | 20221213104438565 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104438565 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104438565 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104438565 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104438565 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104438565 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104438578 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104438586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104438587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104438587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:41.579654 run osmo-msc_10.42.42.6(pid=10353): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10353)] 10:44:41.627834 run osmo-msc_10.42.42.6(pid=10353): stdout: | (launched: 2022-12-13_10:44:40.501949) 10:44:41.677477 run osmo-msc_10.42.42.6(pid=10353): stderr: | 20221213104440774 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104440774 DLGLOBAL DEBUG validating counter group 0x7f4e7b468c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104440774 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104440774 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104440775 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104440775 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104440777 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104440777 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104440777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104440777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:44:41.727571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10346): Terminating (SIGTERM) 10:44:41.767819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10349): Terminating (SIGTERM) 10:44:41.808119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10352): Terminating (SIGTERM) 10:44:41.848733 --- ParallelTerminationStrategy: PID 10346 died... 10:44:41.868518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10346): Terminated: ok {rc=0} 10:44:41.913162 --- ParallelTerminationStrategy: PID 10349 died... 10:44:41.932171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10349): Terminated: ok {rc=0} 10:44:41.976614 --- ParallelTerminationStrategy: PID 10352 died... 10:44:41.995802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10352): Terminated: ok {rc=0} 10:44:42.082275 bus /sierra_3: Setting Powered False 10:44:43.184510 bus /sierra_3: Setting Powered False 10:44:44.301537 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 10:44:45.386997 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:44:45.398390 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 10:44:45.448292 tst emergency_preemptive_call.py: using LAC 33401 10:44:45.575822 tst emergency_preemptive_call.py: using RAC 251 10:44:45.702114 tst emergency_preemptive_call.py: using CellId 33401 10:44:45.824477 tst emergency_preemptive_call.py: using BVCI 33402 10:44:45.968228 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:44:45.980488 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:44:45.992548 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:44:46.004730 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:44:46.017723 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:44:46.030882 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:44:46.158021 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:44:46.284122 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:44:46.426583 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:44:46.554899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:47.061325 run create_hlr_db(pid=10355): Launched 10:44:47.207809 bus /sierra_2: Setting Powered False 10:44:48.267612 run create_hlr_db(pid=10355): Terminated: ok {rc=0} 10:44:48.712614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10357): Launched 10:44:49.038730 run osmo-hlr_10.42.42.2(pid=10358): Launched 10:44:49.163789 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:49.725738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10360): Launched 10:44:50.051754 run osmo-stp_10.42.42.5(pid=10361): Launched 10:44:50.187280 tst emergency_preemptive_call.py: using MSISDN 8114 10:44:50.353929 run osmo-msc_10.42.42.6: Starting osmo-msc 10:44:50.936081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10363): Launched 10:44:51.262534 run osmo-msc_10.42.42.6(pid=10364): Launched 10:44:51.444266 run osmo-stp_10.42.42.5(pid=10361): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10361)] 10:44:51.581767 run osmo-stp_10.42.42.5(pid=10361): stdout: | (launched: 2022-12-13_10:44:49.991442) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:51.719132 run osmo-stp_10.42.42.5(pid=10361): stderr: | 20221213104450180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104450181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104450181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104450181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104450182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104450182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104450182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:51.854844 run osmo-stp_10.42.42.5(pid=10361): stdout: | (launched: 2022-12-13_10:44:49.991442) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:51.984302 run osmo-stp_10.42.42.5(pid=10361): stderr: | 20221213104450180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104450181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104450181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104450181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104450182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104450182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104450182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:52.139765 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10361): Process ended prematurely: osmo-stp_10.42.42.5(pid=10361) [trial-2388↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10361)] [trial-2388↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 10:44:52.149239 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 10:44:52.177135 run osmo-hlr_10.42.42.2(pid=10358): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10358)] 10:44:52.228849 run osmo-hlr_10.42.42.2(pid=10358): stdout: | (launched: 2022-12-13_10:44:48.978759) 10:44:52.281127 run osmo-hlr_10.42.42.2(pid=10358): stderr: | 20221213104449173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104449173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104449173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104449173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104449173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104449173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104449185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104449194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104449194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104449194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:52.354951 run osmo-msc_10.42.42.6(pid=10364): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10364)] 10:44:52.405642 run osmo-msc_10.42.42.6(pid=10364): stdout: | (launched: 2022-12-13_10:44:51.202661) 10:44:52.458608 run osmo-msc_10.42.42.6(pid=10364): stderr: | 20221213104451520 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213104451521 DLGLOBAL DEBUG validating counter group 0x7f1179b49c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213104451521 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213104451521 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213104451521 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213104451521 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213104451523 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213104451524 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213104451524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213104451524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:44:52.511571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10357): Terminating (SIGTERM) 10:44:52.553951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10360): Terminating (SIGTERM) 10:44:52.596879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10363): Terminating (SIGTERM) 10:44:52.639925 --- ParallelTerminationStrategy: PID 10357 died... 10:44:52.661061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10357): Terminated: ok {rc=0} 10:44:52.708912 --- ParallelTerminationStrategy: PID 10360 died... 10:44:52.729370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10360): Terminated: ok {rc=0} 10:44:52.776508 --- ParallelTerminationStrategy: PID 10363 died... 10:44:52.796851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10363): Terminated: ok {rc=0} 10:44:52.886975 bus /sierra_9: Setting Powered False 10:44:53.983491 bus /sierra_9: Setting Powered False 10:44:55.098612 bus /sierra_8: Setting Powered False 10:44:56.197062 bus /sierra_8: Setting Powered False 10:44:57.314096 bus /sierra_3: Setting Powered False 10:44:58.413411 bus /sierra_3: Setting Powered False 10:44:59.530944 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-umtrx --------------------------------------------------------------------- 10:45:00.806868 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:45:00.811702 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:45:00.844581 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 10:45:00.909144 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 10:45:01.022850 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:45:01.057916 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 10:45:01.098917 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 10:45:01.707788 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 10:45:01.782598 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:01.795381 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:45:01.845744 tst cs_paging_gprs_active.py: using LAC 33402 10:45:01.988688 tst cs_paging_gprs_active.py: using RAC 252 10:45:02.172509 tst cs_paging_gprs_active.py: using CellId 33402 10:45:02.297268 tst cs_paging_gprs_active.py: using BVCI 33403 10:45:02.412138 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:02.423065 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:02.433685 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:02.444123 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:02.455126 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:02.466191 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:02.477384 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:02.488307 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:02.499750 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:45:02.621544 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:45:02.745959 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:45:02.953622 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:03.264352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10372): Launched 10:45:03.532934 run iperf3-srv_10.42.42.10(pid=10373): Launched 10:45:03.648191 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:45:03.854204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:04.163605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10374): Launched 10:45:04.431752 run iperf3-srv_10.42.42.10(pid=10375): Launched 10:45:04.547183 tst cs_paging_gprs_active.py:38: start network... 10:45:04.753101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:05.230223 run create_hlr_db(pid=10376): Launched 10:45:05.358246 bus /sierra_2: Setting Powered False 10:45:06.420114 run create_hlr_db(pid=10376): Terminated: ok {rc=0} 10:45:06.869699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10378): Launched 10:45:07.200397 run osmo-hlr_10.42.42.2(pid=10379): Launched 10:45:07.327470 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:07.894891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10381): Launched 10:45:08.224128 run osmo-stp_10.42.42.5(pid=10382): Launched 10:45:08.350920 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:08.918173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10384): Launched 10:45:09.046218 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:09.324941 run patchelf(pid=10385): Launched 10:45:09.508841 run osmo-stp_10.42.42.5(pid=10382): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10382)] 10:45:09.648012 run osmo-stp_10.42.42.5(pid=10382): stdout: | (launched: 2022-12-13_10:45:08.163275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:09.788201 run osmo-stp_10.42.42.5(pid=10382): stderr: | 20221213104508355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104508355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104508355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104508355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104508356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104508356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104508356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:09.928491 run osmo-stp_10.42.42.5(pid=10382): stdout: | (launched: 2022-12-13_10:45:08.163275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:10.063619 run osmo-stp_10.42.42.5(pid=10382): stderr: | 20221213104508355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104508355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104508355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104508355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104508356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104508356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104508356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:10.223564 run patchelf(pid=10385): Terminating (SIGINT) 10:45:10.408519 run patchelf(pid=10385): Terminated: ok {rc=0} 10:45:10.542107 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10382): Process ended prematurely: osmo-stp_10.42.42.5(pid=10382) [trial-2388↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10382)] [trial-2388↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 10:45:10.552343 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:45:10.581041 run osmo-hlr_10.42.42.2(pid=10379): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10379)] 10:45:10.631664 run osmo-hlr_10.42.42.2(pid=10379): stdout: | (launched: 2022-12-13_10:45:07.139498) 10:45:10.684355 run osmo-hlr_10.42.42.2(pid=10379): stderr: | 20221213104507336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104507336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104507336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104507336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104507336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104507336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104507348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104507358 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104507358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104507358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:10.737129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10372): Terminating (SIGTERM) 10:45:10.779075 run iperf3-srv_10.42.42.10(pid=10373): Terminating (SIGTERM) 10:45:10.822531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10374): Terminating (SIGTERM) 10:45:10.865365 run iperf3-srv_10.42.42.10(pid=10375): Terminating (SIGTERM) 10:45:10.907604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10378): Terminating (SIGTERM) 10:45:10.950473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10381): Terminating (SIGTERM) 10:45:10.992576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10384): Terminating (SIGTERM) 10:45:11.035038 --- ParallelTerminationStrategy: PID 10372 died... 10:45:11.055741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10372): Terminated: ok {rc=0} 10:45:11.102424 --- ParallelTerminationStrategy: PID 10373 died... 10:45:11.122331 run iperf3-srv_10.42.42.10(pid=10373): Terminated {rc=256} 10:45:11.168602 --- ParallelTerminationStrategy: PID 10374 died... 10:45:11.188596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10374): Terminated: ok {rc=0} 10:45:11.235581 --- ParallelTerminationStrategy: PID 10375 died... 10:45:11.255598 run iperf3-srv_10.42.42.10(pid=10375): Terminated {rc=256} 10:45:11.301903 --- ParallelTerminationStrategy: PID 10378 died... 10:45:11.321927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10378): Terminated: ok {rc=0} 10:45:11.368276 --- ParallelTerminationStrategy: PID 10381 died... 10:45:11.388261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10381): Terminated: ok {rc=0} 10:45:11.434801 --- ParallelTerminationStrategy: PID 10384 died... 10:45:11.454711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10384): Terminated: ok {rc=0} 10:45:11.543473 bus /gobi_0: Setting Powered False 10:45:12.645262 bus /gobi_0: Setting Powered False 10:45:13.762918 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx iperf3.py ---------------------------------------------- 10:45:14.910943 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:14.922081 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:45:14.977316 tst iperf3.py: using LAC 33403 10:45:15.109167 tst iperf3.py: using RAC 253 10:45:15.230994 tst iperf3.py: using CellId 33403 10:45:15.352226 tst iperf3.py: using BVCI 33404 10:45:15.463133 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:15.474036 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:15.484286 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:15.494624 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:15.504767 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:15.515483 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:15.526422 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:15.536606 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:15.547041 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:45:15.662379 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:45:15.878110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:16.200257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10386): Launched 10:45:16.563112 run iperf3-srv_10.42.42.10(pid=10387): Launched 10:45:16.705607 tst iperf3.py:8: start network... 10:45:16.935085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:17.458072 run create_hlr_db(pid=10388): Launched 10:45:17.584520 bus /gobi_6: Setting Powered False 10:45:18.649623 run create_hlr_db(pid=10388): Terminated: ok {rc=0} 10:45:19.089304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10390): Launched 10:45:19.398446 run osmo-hlr_10.42.42.2(pid=10391): Launched 10:45:19.515416 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:20.043689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10393): Launched 10:45:20.350975 run osmo-stp_10.42.42.5(pid=10394): Launched 10:45:20.469048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:20.997222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10396): Launched 10:45:21.115736 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:21.375669 run patchelf(pid=10397): Launched 10:45:21.546157 run osmo-stp_10.42.42.5(pid=10394): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10394)] 10:45:21.675298 run osmo-stp_10.42.42.5(pid=10394): stdout: | (launched: 2022-12-13_10:45:20.293557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:21.805852 run osmo-stp_10.42.42.5(pid=10394): stderr: | 20221213104520462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104520462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104520462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104520463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104520463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104520463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104520463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:21.936086 run osmo-stp_10.42.42.5(pid=10394): stdout: | (launched: 2022-12-13_10:45:20.293557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:22.061257 run osmo-stp_10.42.42.5(pid=10394): stderr: | 20221213104520462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104520462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104520462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104520463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104520463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104520463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104520463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:22.209538 run patchelf(pid=10397): Terminating (SIGINT) 10:45:22.380557 run patchelf(pid=10397): Terminated: ok {rc=0} 10:45:22.504159 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10394): Process ended prematurely: osmo-stp_10.42.42.5(pid=10394) [trial-2388↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10394)] [trial-2388↪gprs:trx-umtrx↪iperf3.py:8] 10:45:22.513798 tst iperf3.py:8: Test FAILED (7.6 sec) 10:45:22.540607 run osmo-hlr_10.42.42.2(pid=10391): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10391)] 10:45:22.588517 run osmo-hlr_10.42.42.2(pid=10391): stdout: | (launched: 2022-12-13_10:45:19.340926) 10:45:22.638011 run osmo-hlr_10.42.42.2(pid=10391): stderr: | 20221213104519517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104519517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104519517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104519517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104519517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104519517 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104519528 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104519537 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104519537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104519537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:22.687939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10386): Terminating (SIGTERM) 10:45:22.727593 run iperf3-srv_10.42.42.10(pid=10387): Terminating (SIGTERM) 10:45:22.767039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10390): Terminating (SIGTERM) 10:45:22.806725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10393): Terminating (SIGTERM) 10:45:22.846587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10396): Terminating (SIGTERM) 10:45:22.887176 --- ParallelTerminationStrategy: PID 10386 died... 10:45:22.906309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10386): Terminated: ok {rc=0} 10:45:22.950124 --- ParallelTerminationStrategy: PID 10387 died... 10:45:22.968747 run iperf3-srv_10.42.42.10(pid=10387): Terminated {rc=256} 10:45:23.012353 --- ParallelTerminationStrategy: PID 10390 died... 10:45:23.031032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10390): Terminated: ok {rc=0} 10:45:23.074903 --- ParallelTerminationStrategy: PID 10393 died... 10:45:23.093610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10393): Terminated: ok {rc=0} 10:45:23.137389 --- ParallelTerminationStrategy: PID 10396 died... 10:45:23.156042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10396): Terminated: ok {rc=0} 10:45:23.241414 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 10:45:24.389793 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:24.401042 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:45:24.450423 tst iperf3m4.py: using LAC 33404 10:45:24.569723 tst iperf3m4.py: using RAC 254 10:45:24.688219 tst iperf3m4.py: using CellId 33404 10:45:24.806458 tst iperf3m4.py: using BVCI 33405 10:45:24.918759 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:24.929507 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:24.939882 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:24.950295 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:24.960557 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:24.970889 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:24.981900 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:24.992596 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:25.003222 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:45:25.124927 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:45:25.251268 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:45:25.372331 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:45:25.494096 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:45:25.717786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:26.050726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10398): Launched 10:45:26.338349 run iperf3-srv_10.42.42.10(pid=10399): Launched 10:45:26.462504 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:45:26.686344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:27.019001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10400): Launched 10:45:27.307306 run iperf3-srv_10.42.42.10(pid=10401): Launched 10:45:27.432417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:45:27.654963 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:27.986655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10402): Launched 10:45:28.274950 run iperf3-srv_10.42.42.10(pid=10403): Launched 10:45:28.400105 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:45:28.623448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:28.955703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10404): Launched 10:45:29.244335 run iperf3-srv_10.42.42.10(pid=10405): Launched 10:45:29.370413 tst iperf3m4.py:8: start network... 10:45:29.594687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:30.109753 run create_hlr_db(pid=10406): Launched 10:45:30.237746 bus /gobi_6: Setting Powered False 10:45:31.301159 run create_hlr_db(pid=10406): Terminated: ok {rc=0} 10:45:31.768885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10408): Launched 10:45:32.121742 run osmo-hlr_10.42.42.2(pid=10409): Launched 10:45:32.243461 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:32.778580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10411): Launched 10:45:33.089335 run osmo-stp_10.42.42.5(pid=10412): Launched 10:45:33.207669 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:33.738522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10414): Launched 10:45:33.857821 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:34.118379 run patchelf(pid=10415): Launched 10:45:34.290557 run osmo-stp_10.42.42.5(pid=10412): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10412)] 10:45:34.420682 run osmo-stp_10.42.42.5(pid=10412): stdout: | (launched: 2022-12-13_10:45:33.031668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:34.552042 run osmo-stp_10.42.42.5(pid=10412): stderr: | 20221213104533203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104533203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104533203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104533204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104533204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104533204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104533204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:34.683821 run osmo-stp_10.42.42.5(pid=10412): stdout: | (launched: 2022-12-13_10:45:33.031668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:34.809631 run osmo-stp_10.42.42.5(pid=10412): stderr: | 20221213104533203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104533203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104533203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104533204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104533204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104533204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104533204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:34.958491 run patchelf(pid=10415): Terminating (SIGINT) 10:45:35.130902 run patchelf(pid=10415): Terminated: ok {rc=0} 10:45:35.255211 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10412): Process ended prematurely: osmo-stp_10.42.42.5(pid=10412) [trial-2388↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10412)] [trial-2388↪gprs:trx-umtrx↪iperf3m4.py:8] 10:45:35.264690 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:45:35.292228 run osmo-hlr_10.42.42.2(pid=10409): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10409)] 10:45:35.340541 run osmo-hlr_10.42.42.2(pid=10409): stdout: | (launched: 2022-12-13_10:45:32.055704) 10:45:35.390481 run osmo-hlr_10.42.42.2(pid=10409): stderr: | 20221213104532267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104532267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104532267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104532267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104532267 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104532267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104532279 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104532288 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104532288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104532288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:35.440464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10398): Terminating (SIGTERM) 10:45:35.480416 run iperf3-srv_10.42.42.10(pid=10399): Terminating (SIGTERM) 10:45:35.520159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10400): Terminating (SIGTERM) 10:45:35.560144 run iperf3-srv_10.42.42.10(pid=10401): Terminating (SIGTERM) 10:45:35.599907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10402): Terminating (SIGTERM) 10:45:35.639699 run iperf3-srv_10.42.42.10(pid=10403): Terminating (SIGTERM) 10:45:35.679442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10404): Terminating (SIGTERM) 10:45:35.719207 run iperf3-srv_10.42.42.10(pid=10405): Terminating (SIGTERM) 10:45:35.758773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10408): Terminating (SIGTERM) 10:45:35.798672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10411): Terminating (SIGTERM) 10:45:35.838424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10414): Terminating (SIGTERM) 10:45:35.879355 --- ParallelTerminationStrategy: PID 10398 died... 10:45:35.898760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10398): Terminated: ok {rc=0} 10:45:35.942889 --- ParallelTerminationStrategy: PID 10399 died... 10:45:35.961538 run iperf3-srv_10.42.42.10(pid=10399): Terminated {rc=256} 10:45:36.005536 --- ParallelTerminationStrategy: PID 10400 died... 10:45:36.024159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10400): Terminated: ok {rc=0} 10:45:36.068224 --- ParallelTerminationStrategy: PID 10401 died... 10:45:36.086982 run iperf3-srv_10.42.42.10(pid=10401): Terminated {rc=256} 10:45:36.130989 --- ParallelTerminationStrategy: PID 10402 died... 10:45:36.149648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10402): Terminated: ok {rc=0} 10:45:36.193628 --- ParallelTerminationStrategy: PID 10403 died... 10:45:36.212265 run iperf3-srv_10.42.42.10(pid=10403): Terminated {rc=256} 10:45:36.255996 --- ParallelTerminationStrategy: PID 10404 died... 10:45:36.274747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10404): Terminated: ok {rc=0} 10:45:36.318661 --- ParallelTerminationStrategy: PID 10405 died... 10:45:36.337230 run iperf3-srv_10.42.42.10(pid=10405): Terminated {rc=256} 10:45:36.381121 --- ParallelTerminationStrategy: PID 10408 died... 10:45:36.399995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10408): Terminated: ok {rc=0} 10:45:36.444053 --- ParallelTerminationStrategy: PID 10411 died... 10:45:36.462860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10411): Terminated: ok {rc=0} 10:45:36.506804 --- ParallelTerminationStrategy: PID 10414 died... 10:45:36.525579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10414): Terminated: ok {rc=0} 10:45:36.611667 bus /gobi_4: Setting Powered False 10:45:37.712234 bus /gobi_4: Setting Powered False 10:45:38.827876 bus /gobi_1: Setting Powered False 10:45:39.927657 bus /gobi_1: Setting Powered False 10:45:41.043625 bus /gobi_0: Setting Powered False 10:45:42.143954 bus /gobi_0: Setting Powered False 10:45:43.264922 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx ping.py ---------------------------------------------- 10:45:44.371890 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:44.383771 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:45:44.433139 tst ping.py: using LAC 33405 10:45:44.557689 tst ping.py: using RAC 255 10:45:44.677859 tst ping.py: using CellId 33405 10:45:44.793645 tst ping.py: using BVCI 33406 10:45:44.904008 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:44.914631 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:44.925115 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:44.935458 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:44.945850 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:44.956659 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:44.967360 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:44.978008 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:45:45.097629 tst ping.py:19: start network... 10:45:45.316126 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:45.819843 run create_hlr_db(pid=10416): Launched 10:45:45.986188 bus /gobi_6: Setting Powered False 10:45:47.061377 run create_hlr_db(pid=10416): Terminated: ok {rc=0} 10:45:47.518846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10418): Launched 10:45:47.822522 run osmo-hlr_10.42.42.2(pid=10419): Launched 10:45:47.936147 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:48.471262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10421): Launched 10:45:48.774015 run osmo-stp_10.42.42.5(pid=10422): Launched 10:45:48.890380 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:49.409814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10424): Launched 10:45:49.525575 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:49.781199 run patchelf(pid=10425): Launched 10:45:49.949771 run osmo-stp_10.42.42.5(pid=10422): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10422)] 10:45:50.077602 run osmo-stp_10.42.42.5(pid=10422): stdout: | (launched: 2022-12-13_10:45:48.717639) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:50.206567 run osmo-stp_10.42.42.5(pid=10422): stderr: | 20221213104548888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104548888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104548889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104548889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104548890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104548890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104548890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:50.335872 run osmo-stp_10.42.42.5(pid=10422): stdout: | (launched: 2022-12-13_10:45:48.717639) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:50.459305 run osmo-stp_10.42.42.5(pid=10422): stderr: | 20221213104548888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104548888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104548889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104548889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104548890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104548890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104548890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:50.605770 run patchelf(pid=10425): Terminating (SIGINT) 10:45:50.775089 run patchelf(pid=10425): Terminated: ok {rc=0} 10:45:50.896729 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10422): Process ended prematurely: osmo-stp_10.42.42.5(pid=10422) [trial-2388↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10422)] [trial-2388↪gprs:trx-umtrx↪ping.py:22] 10:45:50.905759 tst ping.py:22: Test FAILED (6.5 sec) 10:45:50.932383 run osmo-hlr_10.42.42.2(pid=10419): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10419)] 10:45:50.979746 run osmo-hlr_10.42.42.2(pid=10419): stdout: | (launched: 2022-12-13_10:45:47.766287) 10:45:51.029066 run osmo-hlr_10.42.42.2(pid=10419): stderr: | 20221213104547940 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104547940 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104547940 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104547940 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104547940 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104547940 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104547953 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104547963 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104547964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104547964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:51.078551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10418): Terminating (SIGTERM) 10:45:51.118348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10421): Terminating (SIGTERM) 10:45:51.158381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10424): Terminating (SIGTERM) 10:45:51.199297 --- ParallelTerminationStrategy: PID 10418 died... 10:45:51.218633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10418): Terminated: ok {rc=0} 10:45:51.262802 --- ParallelTerminationStrategy: PID 10421 died... 10:45:51.281646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10421): Terminated: ok {rc=0} 10:45:51.325641 --- ParallelTerminationStrategy: PID 10424 died... 10:45:51.344392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10424): Terminated: ok {rc=0} 10:45:51.428115 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 10:45:52.514815 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:52.525957 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:45:52.574223 tst ping_idle_ping.py: using LAC 33406 10:45:52.694326 tst ping_idle_ping.py: using RAC 1 10:45:52.813574 tst ping_idle_ping.py: using CellId 33406 10:45:52.931767 tst ping_idle_ping.py: using BVCI 33407 10:45:53.041456 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:53.052156 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:53.062882 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:53.073350 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:53.083708 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:53.094054 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:53.104480 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:45:53.115484 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:45:53.234995 tst ping_idle_ping.py:24: start network... 10:45:53.454196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:53.960657 run create_hlr_db(pid=10426): Launched 10:45:54.087432 bus /gobi_6: Setting Powered False 10:45:55.152041 run create_hlr_db(pid=10426): Terminated: ok {rc=0} 10:45:55.590836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10428): Launched 10:45:55.894950 run osmo-hlr_10.42.42.2(pid=10429): Launched 10:45:56.010123 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:56.548861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10431): Launched 10:45:56.853477 run osmo-stp_10.42.42.5(pid=10432): Launched 10:45:56.967896 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:57.489341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10434): Launched 10:45:57.605895 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:57.861345 run patchelf(pid=10435): Launched 10:45:58.029286 run osmo-stp_10.42.42.5(pid=10432): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10432)] 10:45:58.157454 run osmo-stp_10.42.42.5(pid=10432): stdout: | (launched: 2022-12-13_10:45:56.796455) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:58.286721 run osmo-stp_10.42.42.5(pid=10432): stderr: | 20221213104556967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104556967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104556967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104556968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104556968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104556968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104556968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:58.416393 run osmo-stp_10.42.42.5(pid=10432): stdout: | (launched: 2022-12-13_10:45:56.796455) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:58.540176 run osmo-stp_10.42.42.5(pid=10432): stderr: | 20221213104556967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104556967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104556967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104556968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104556968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104556968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104556968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:58.687131 run patchelf(pid=10435): Terminating (SIGINT) 10:45:58.857590 run patchelf(pid=10435): Terminated: ok {rc=0} 10:45:58.980010 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10432): Process ended prematurely: osmo-stp_10.42.42.5(pid=10432) [trial-2388↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10432)] [trial-2388↪gprs:trx-umtrx↪ping_idle_ping.py:27] 10:45:58.989115 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:45:59.015917 run osmo-hlr_10.42.42.2(pid=10429): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10429)] 10:45:59.063648 run osmo-hlr_10.42.42.2(pid=10429): stdout: | (launched: 2022-12-13_10:45:55.838382) 10:45:59.113447 run osmo-hlr_10.42.42.2(pid=10429): stderr: | 20221213104556012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104556013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104556013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104556013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104556013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104556013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104556025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104556034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104556034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104556034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:59.163536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10428): Terminating (SIGTERM) 10:45:59.203476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10431): Terminating (SIGTERM) 10:45:59.243370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10434): Terminating (SIGTERM) 10:45:59.283922 --- ParallelTerminationStrategy: PID 10428 died... 10:45:59.303378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10428): Terminated: ok {rc=0} 10:45:59.348026 --- ParallelTerminationStrategy: PID 10431 died... 10:45:59.367042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10431): Terminated: ok {rc=0} 10:45:59.411501 --- ParallelTerminationStrategy: PID 10434 died... 10:45:59.430592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10434): Terminated: ok {rc=0} 10:45:59.517402 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 10:46:00.817198 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:46:00.823043 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:46:00.856294 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:46:00.922089 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:46:01.023421 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:46:01.073208 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:46:01.117233 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:46:01.725574 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:46:01.784429 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:01.796829 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:46:01.857505 tst cs_paging_gprs_active.py: using LAC 33407 10:46:01.992760 tst cs_paging_gprs_active.py: using RAC 2 10:46:02.126673 tst cs_paging_gprs_active.py: using CellId 33407 10:46:02.269278 tst cs_paging_gprs_active.py: using BVCI 33408 10:46:02.392037 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:02.403635 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:02.414779 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:02.426163 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:02.437708 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:02.449266 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:02.461134 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:02.472469 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:02.484066 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:46:02.602474 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:46:02.724294 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:46:02.949851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:03.283795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10439): Launched 10:46:03.574703 run iperf3-srv_10.42.42.10(pid=10440): Launched 10:46:03.699298 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:46:03.923239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:04.256579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10441): Launched 10:46:04.547393 run iperf3-srv_10.42.42.10(pid=10442): Launched 10:46:04.672936 tst cs_paging_gprs_active.py:38: start network... 10:46:04.897709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:05.413745 run create_hlr_db(pid=10443): Launched 10:46:05.542364 bus /gobi_6: Setting Powered False 10:46:06.603922 run create_hlr_db(pid=10443): Terminated: ok {rc=0} 10:46:07.055261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10445): Launched 10:46:07.389681 run osmo-hlr_10.42.42.2(pid=10446): Launched 10:46:07.517477 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:08.093144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10448): Launched 10:46:08.423678 run osmo-stp_10.42.42.5(pid=10449): Launched 10:46:08.551725 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:46:09.122493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10451): Launched 10:46:09.250485 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:46:09.530686 run patchelf(pid=10452): Launched 10:46:09.714258 run osmo-stp_10.42.42.5(pid=10449): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10449)] 10:46:09.854307 run osmo-stp_10.42.42.5(pid=10449): stdout: | (launched: 2022-12-13_10:46:08.362686) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:09.995530 run osmo-stp_10.42.42.5(pid=10449): stderr: | 20221213104608551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104608551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104608551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104608552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104608552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104608553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104608553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:10.136644 run osmo-stp_10.42.42.5(pid=10449): stdout: | (launched: 2022-12-13_10:46:08.362686) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:10.271867 run osmo-stp_10.42.42.5(pid=10449): stderr: | 20221213104608551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104608551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104608551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104608552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104608552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104608553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104608553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:10.432112 run patchelf(pid=10452): Terminating (SIGINT) 10:46:10.617927 run patchelf(pid=10452): Terminated: ok {rc=0} 10:46:10.751850 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10449): Process ended prematurely: osmo-stp_10.42.42.5(pid=10449) [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10449)] [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:46:10.762168 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 10:46:10.790820 run osmo-hlr_10.42.42.2(pid=10446): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10446)] 10:46:10.842064 run osmo-hlr_10.42.42.2(pid=10446): stdout: | (launched: 2022-12-13_10:46:07.328506) 10:46:10.894040 run osmo-hlr_10.42.42.2(pid=10446): stderr: | 20221213104607524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104607524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104607524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104607524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104607524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104607525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104607536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104607545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104607545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104607545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:10.947314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10439): Terminating (SIGTERM) 10:46:10.989274 run iperf3-srv_10.42.42.10(pid=10440): Terminating (SIGTERM) 10:46:11.031529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10441): Terminating (SIGTERM) 10:46:11.074458 run iperf3-srv_10.42.42.10(pid=10442): Terminating (SIGTERM) 10:46:11.116807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10445): Terminating (SIGTERM) 10:46:11.159581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10448): Terminating (SIGTERM) 10:46:11.202057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10451): Terminating (SIGTERM) 10:46:11.244596 --- ParallelTerminationStrategy: PID 10439 died... 10:46:11.265540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10439): Terminated: ok {rc=0} 10:46:11.312628 --- ParallelTerminationStrategy: PID 10440 died... 10:46:11.332826 run iperf3-srv_10.42.42.10(pid=10440): Terminated {rc=256} 10:46:11.379485 --- ParallelTerminationStrategy: PID 10441 died... 10:46:11.399706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10441): Terminated: ok {rc=0} 10:46:11.446326 --- ParallelTerminationStrategy: PID 10442 died... 10:46:11.466546 run iperf3-srv_10.42.42.10(pid=10442): Terminated {rc=256} 10:46:11.513146 --- ParallelTerminationStrategy: PID 10445 died... 10:46:11.533453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10445): Terminated: ok {rc=0} 10:46:11.580158 --- ParallelTerminationStrategy: PID 10448 died... 10:46:11.600394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10448): Terminated: ok {rc=0} 10:46:11.647269 --- ParallelTerminationStrategy: PID 10451 died... 10:46:11.667592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10451): Terminated: ok {rc=0} 10:46:11.756924 bus /gobi_0: Setting Powered False 10:46:12.857068 bus /gobi_0: Setting Powered False 10:46:13.974026 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:46:15.125459 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:15.137459 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:46:15.191733 tst iperf3.py: using LAC 33408 10:46:15.322787 tst iperf3.py: using RAC 3 10:46:15.453280 tst iperf3.py: using CellId 33408 10:46:15.583279 tst iperf3.py: using BVCI 33409 10:46:15.704928 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:15.716321 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:15.727559 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:15.738676 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:15.749988 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:15.761388 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:15.772837 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:15.784223 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:15.795767 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:46:15.926939 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:46:16.139030 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:16.457186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10453): Launched 10:46:16.749727 run iperf3-srv_10.42.42.10(pid=10454): Launched 10:46:16.884935 tst iperf3.py:8: start network... 10:46:17.112942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:17.629164 run create_hlr_db(pid=10455): Launched 10:46:17.755253 bus /gobi_6: Setting Powered False 10:46:18.819667 run create_hlr_db(pid=10455): Terminated: ok {rc=0} 10:46:19.277680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10457): Launched 10:46:19.607418 run osmo-hlr_10.42.42.2(pid=10458): Launched 10:46:19.734719 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:20.310755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10460): Launched 10:46:20.641541 run osmo-stp_10.42.42.5(pid=10461): Launched 10:46:20.768551 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:46:21.337218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10463): Launched 10:46:21.464599 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:46:21.743670 run patchelf(pid=10464): Launched 10:46:21.952079 run osmo-stp_10.42.42.5(pid=10461): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10461)] 10:46:22.091664 run osmo-stp_10.42.42.5(pid=10461): stdout: | (launched: 2022-12-13_10:46:20.580095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:22.232072 run osmo-stp_10.42.42.5(pid=10461): stderr: | 20221213104620776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104620776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104620776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104620776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104620777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104620777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104620777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:22.372364 run osmo-stp_10.42.42.5(pid=10461): stdout: | (launched: 2022-12-13_10:46:20.580095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:22.507291 run osmo-stp_10.42.42.5(pid=10461): stderr: | 20221213104620776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104620776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104620776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104620776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104620777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104620777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104620777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:22.666922 run patchelf(pid=10464): Terminating (SIGINT) 10:46:22.851539 run patchelf(pid=10464): Terminated: ok {rc=0} 10:46:22.985101 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10461): Process ended prematurely: osmo-stp_10.42.42.5(pid=10461) [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10461)] [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 10:46:22.995338 tst iperf3.py:8: Test FAILED (7.9 sec) 10:46:23.024016 run osmo-hlr_10.42.42.2(pid=10458): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10458)] 10:46:23.074891 run osmo-hlr_10.42.42.2(pid=10458): stdout: | (launched: 2022-12-13_10:46:19.546434) 10:46:23.127957 run osmo-hlr_10.42.42.2(pid=10458): stderr: | 20221213104619744 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104619744 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104619744 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104619744 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104619744 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104619744 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104619756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104619765 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104619765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104619765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:23.181182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10453): Terminating (SIGTERM) 10:46:23.223034 run iperf3-srv_10.42.42.10(pid=10454): Terminating (SIGTERM) 10:46:23.266495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10457): Terminating (SIGTERM) 10:46:23.308927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10460): Terminating (SIGTERM) 10:46:23.350948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10463): Terminating (SIGTERM) 10:46:23.393314 --- ParallelTerminationStrategy: PID 10453 died... 10:46:23.413732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10453): Terminated: ok {rc=0} 10:46:23.460207 --- ParallelTerminationStrategy: PID 10454 died... 10:46:23.480078 run iperf3-srv_10.42.42.10(pid=10454): Terminated {rc=256} 10:46:23.526354 --- ParallelTerminationStrategy: PID 10457 died... 10:46:23.546263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10457): Terminated: ok {rc=0} 10:46:23.592500 --- ParallelTerminationStrategy: PID 10460 died... 10:46:23.612476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10460): Terminated: ok {rc=0} 10:46:23.658707 --- ParallelTerminationStrategy: PID 10463 died... 10:46:23.678709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10463): Terminated: ok {rc=0} 10:46:23.767749 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:46:24.918762 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:24.930585 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:46:24.983155 tst iperf3m4.py: using LAC 33409 10:46:25.113158 tst iperf3m4.py: using RAC 4 10:46:25.243457 tst iperf3m4.py: using CellId 33409 10:46:25.374198 tst iperf3m4.py: using BVCI 33410 10:46:25.494002 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:25.505403 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:25.516312 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:25.527468 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:25.538868 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:25.549885 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:25.561364 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:25.572478 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:25.583759 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:46:25.704622 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:46:25.825216 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:46:25.944078 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:46:26.062094 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:46:26.269394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:26.579846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10465): Launched 10:46:26.849361 run iperf3-srv_10.42.42.10(pid=10466): Launched 10:46:26.964925 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:46:27.171092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:27.482047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10467): Launched 10:46:27.751918 run iperf3-srv_10.42.42.10(pid=10468): Launched 10:46:27.867796 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:46:28.074012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:28.383463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10469): Launched 10:46:28.653261 run iperf3-srv_10.42.42.10(pid=10470): Launched 10:46:28.767903 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:46:28.973159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:29.281899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10471): Launched 10:46:29.549158 run iperf3-srv_10.42.42.10(pid=10472): Launched 10:46:29.664887 tst iperf3m4.py:8: start network... 10:46:29.870670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:30.346070 run create_hlr_db(pid=10473): Launched 10:46:30.471976 bus /gobi_6: Setting Powered False 10:46:31.531561 run create_hlr_db(pid=10473): Terminated: ok {rc=0} 10:46:31.970626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10475): Launched 10:46:32.294230 run osmo-hlr_10.42.42.2(pid=10476): Launched 10:46:32.414140 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:32.942949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10478): Launched 10:46:33.252036 run osmo-stp_10.42.42.5(pid=10479): Launched 10:46:33.370085 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:46:33.899881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10481): Launched 10:46:34.017479 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:46:34.278412 run patchelf(pid=10482): Launched 10:46:34.451199 run osmo-stp_10.42.42.5(pid=10479): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10479)] 10:46:34.581250 run osmo-stp_10.42.42.5(pid=10479): stdout: | (launched: 2022-12-13_10:46:33.194762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:34.712538 run osmo-stp_10.42.42.5(pid=10479): stderr: | 20221213104633363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104633363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104633363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104633364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104633364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104633364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104633364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:34.843966 run osmo-stp_10.42.42.5(pid=10479): stdout: | (launched: 2022-12-13_10:46:33.194762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:34.969915 run osmo-stp_10.42.42.5(pid=10479): stderr: | 20221213104633363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104633363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104633363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104633364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104633364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104633364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104633364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:35.119340 run patchelf(pid=10482): Terminating (SIGINT) 10:46:35.291790 run patchelf(pid=10482): Terminated: ok {rc=0} 10:46:35.416514 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10479): Process ended prematurely: osmo-stp_10.42.42.5(pid=10479) [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10479)] [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 10:46:35.426087 tst iperf3m4.py:8: Test FAILED (10.5 sec) 10:46:35.453424 run osmo-hlr_10.42.42.2(pid=10476): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10476)] 10:46:35.501520 run osmo-hlr_10.42.42.2(pid=10476): stdout: | (launched: 2022-12-13_10:46:32.236523) 10:46:35.550650 run osmo-hlr_10.42.42.2(pid=10476): stderr: | 20221213104632411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104632411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104632411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104632411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104632411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104632411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104632423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104632431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104632432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104632432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:35.600183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10465): Terminating (SIGTERM) 10:46:35.639728 run iperf3-srv_10.42.42.10(pid=10466): Terminating (SIGTERM) 10:46:35.679379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10467): Terminating (SIGTERM) 10:46:35.719273 run iperf3-srv_10.42.42.10(pid=10468): Terminating (SIGTERM) 10:46:35.758913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10469): Terminating (SIGTERM) 10:46:35.798824 run iperf3-srv_10.42.42.10(pid=10470): Terminating (SIGTERM) 10:46:35.839330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10471): Terminating (SIGTERM) 10:46:35.880004 run iperf3-srv_10.42.42.10(pid=10472): Terminating (SIGTERM) 10:46:35.920248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10475): Terminating (SIGTERM) 10:46:35.961068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10478): Terminating (SIGTERM) 10:46:36.001400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10481): Terminating (SIGTERM) 10:46:36.042075 --- ParallelTerminationStrategy: PID 10465 died... 10:46:36.061364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10465): Terminated: ok {rc=0} 10:46:36.105913 --- ParallelTerminationStrategy: PID 10466 died... 10:46:36.124408 run iperf3-srv_10.42.42.10(pid=10466): Terminated {rc=256} 10:46:36.168331 --- ParallelTerminationStrategy: PID 10467 died... 10:46:36.187025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10467): Terminated: ok {rc=0} 10:46:36.231137 --- ParallelTerminationStrategy: PID 10468 died... 10:46:36.249846 run iperf3-srv_10.42.42.10(pid=10468): Terminated {rc=256} 10:46:36.293661 --- ParallelTerminationStrategy: PID 10469 died... 10:46:36.312358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10469): Terminated: ok {rc=0} 10:46:36.356637 --- ParallelTerminationStrategy: PID 10470 died... 10:46:36.375428 run iperf3-srv_10.42.42.10(pid=10470): Terminated {rc=256} 10:46:36.419202 --- ParallelTerminationStrategy: PID 10471 died... 10:46:36.437984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10471): Terminated: ok {rc=0} 10:46:36.482707 --- ParallelTerminationStrategy: PID 10472 died... 10:46:36.501625 run iperf3-srv_10.42.42.10(pid=10472): Terminated {rc=256} 10:46:36.545629 --- ParallelTerminationStrategy: PID 10475 died... 10:46:36.564422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10475): Terminated: ok {rc=0} 10:46:36.608594 --- ParallelTerminationStrategy: PID 10478 died... 10:46:36.627501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10478): Terminated: ok {rc=0} 10:46:36.671573 --- ParallelTerminationStrategy: PID 10481 died... 10:46:36.690447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10481): Terminated: ok {rc=0} 10:46:36.775211 bus /gobi_4: Setting Powered False 10:46:37.872429 bus /gobi_4: Setting Powered False 10:46:38.988648 bus /gobi_1: Setting Powered False 10:46:40.088504 bus /gobi_1: Setting Powered False 10:46:41.202394 bus /gobi_0: Setting Powered False 10:46:42.298082 bus /gobi_0: Setting Powered False 10:46:43.414542 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 10:46:44.520654 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:44.533110 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:46:44.588763 tst ping.py: using LAC 33410 10:46:44.714826 tst ping.py: using RAC 5 10:46:44.841758 tst ping.py: using CellId 33410 10:46:44.968522 tst ping.py: using BVCI 33411 10:46:45.087191 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:45.099033 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:45.110237 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:45.121309 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:45.132738 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:45.144298 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:45.156034 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:45.167588 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:46:45.284781 tst ping.py:19: start network... 10:46:45.486237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:45.956815 run create_hlr_db(pid=10483): Launched 10:46:46.115922 bus /gobi_6: Setting Powered False 10:46:47.175120 run create_hlr_db(pid=10483): Terminated: ok {rc=0} 10:46:47.601244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10485): Launched 10:46:47.906103 run osmo-hlr_10.42.42.2(pid=10486): Launched 10:46:48.022504 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:48.545098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10488): Launched 10:46:48.847594 run osmo-stp_10.42.42.5(pid=10489): Launched 10:46:48.960618 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:46:49.480533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10491): Launched 10:46:49.595454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:46:49.850606 run patchelf(pid=10492): Launched 10:46:50.018243 run osmo-stp_10.42.42.5(pid=10489): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10489)] 10:46:50.144907 run osmo-stp_10.42.42.5(pid=10489): stdout: | (launched: 2022-12-13_10:46:48.790697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:50.273679 run osmo-stp_10.42.42.5(pid=10489): stderr: | 20221213104648960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104648960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104648960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104648961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104648961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104648961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104648961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:50.402205 run osmo-stp_10.42.42.5(pid=10489): stdout: | (launched: 2022-12-13_10:46:48.790697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:50.524804 run osmo-stp_10.42.42.5(pid=10489): stderr: | 20221213104648960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104648960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104648960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104648961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104648961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104648961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104648961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:50.670289 run patchelf(pid=10492): Terminating (SIGINT) 10:46:50.839152 run patchelf(pid=10492): Terminated: ok {rc=0} 10:46:50.960775 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10489): Process ended prematurely: osmo-stp_10.42.42.5(pid=10489) [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10489)] [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 10:46:50.969738 tst ping.py:22: Test FAILED (6.4 sec) 10:46:50.996508 run osmo-hlr_10.42.42.2(pid=10486): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10486)] 10:46:51.044160 run osmo-hlr_10.42.42.2(pid=10486): stdout: | (launched: 2022-12-13_10:46:47.848551) 10:46:51.093834 run osmo-hlr_10.42.42.2(pid=10486): stderr: | 20221213104648024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104648024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104648024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104648024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104648024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104648024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104648037 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104648048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104648048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104648048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:51.143901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10485): Terminating (SIGTERM) 10:46:51.183948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10488): Terminating (SIGTERM) 10:46:51.223815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10491): Terminating (SIGTERM) 10:46:51.264000 --- ParallelTerminationStrategy: PID 10485 died... 10:46:51.283384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10485): Terminated: ok {rc=0} 10:46:51.327624 --- ParallelTerminationStrategy: PID 10488 died... 10:46:51.346347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10488): Terminated: ok {rc=0} 10:46:51.390369 --- ParallelTerminationStrategy: PID 10491 died... 10:46:51.409169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10491): Terminated: ok {rc=0} 10:46:51.493813 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:46:52.581806 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:52.594635 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:46:52.647879 tst ping_idle_ping.py: using LAC 33411 10:46:52.773945 tst ping_idle_ping.py: using RAC 6 10:46:52.902386 tst ping_idle_ping.py: using CellId 33411 10:46:53.030141 tst ping_idle_ping.py: using BVCI 33412 10:46:53.147828 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:53.159238 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:53.170510 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:53.181592 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:53.192908 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:53.204812 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:53.216899 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:53.228326 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:46:53.350825 tst ping_idle_ping.py:24: start network... 10:46:53.570545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:54.078360 run create_hlr_db(pid=10493): Launched 10:46:54.201952 bus /gobi_6: Setting Powered False 10:46:55.266115 run create_hlr_db(pid=10493): Terminated: ok {rc=0} 10:46:55.702846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10495): Launched 10:46:56.007045 run osmo-hlr_10.42.42.2(pid=10496): Launched 10:46:56.122292 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:56.659714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10498): Launched 10:46:56.965145 run osmo-stp_10.42.42.5(pid=10499): Launched 10:46:57.081892 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:46:57.602576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10501): Launched 10:46:57.719376 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:46:57.975921 run patchelf(pid=10502): Launched 10:46:58.146357 run osmo-stp_10.42.42.5(pid=10499): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10499)] 10:46:58.274248 run osmo-stp_10.42.42.5(pid=10499): stdout: | (launched: 2022-12-13_10:46:56.908406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:58.403885 run osmo-stp_10.42.42.5(pid=10499): stderr: | 20221213104657075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104657076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104657076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104657076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104657077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104657077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104657077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:58.533315 run osmo-stp_10.42.42.5(pid=10499): stdout: | (launched: 2022-12-13_10:46:56.908406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:58.657374 run osmo-stp_10.42.42.5(pid=10499): stderr: | 20221213104657075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104657076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104657076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104657076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104657077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104657077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104657077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:58.804095 run patchelf(pid=10502): Terminating (SIGINT) 10:46:58.974961 run patchelf(pid=10502): Terminated: ok {rc=0} 10:46:59.097509 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10499): Process ended prematurely: osmo-stp_10.42.42.5(pid=10499) [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10499)] [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 10:46:59.106779 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:46:59.133977 run osmo-hlr_10.42.42.2(pid=10496): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10496)] 10:46:59.182192 run osmo-hlr_10.42.42.2(pid=10496): stdout: | (launched: 2022-12-13_10:46:55.949832) 10:46:59.232053 run osmo-hlr_10.42.42.2(pid=10496): stderr: | 20221213104656125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104656125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104656125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104656125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104656125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104656125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104656137 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104656147 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104656147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104656147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:59.282163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10495): Terminating (SIGTERM) 10:46:59.322411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10498): Terminating (SIGTERM) 10:46:59.362617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10501): Terminating (SIGTERM) 10:46:59.403191 --- ParallelTerminationStrategy: PID 10495 died... 10:46:59.422258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10495): Terminated: ok {rc=0} 10:46:59.466648 --- ParallelTerminationStrategy: PID 10498 died... 10:46:59.485595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10498): Terminated: ok {rc=0} 10:46:59.529985 --- ParallelTerminationStrategy: PID 10501 died... 10:46:59.549024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10501): Terminated: ok {rc=0} 10:46:59.635973 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:47:00.943390 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:47:00.953921 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:47:00.995487 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:47:01.034324 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:47:01.121166 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:47:01.166862 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:47:01.221287 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:47:01.791195 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:47:01.843081 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:01.854915 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:47:01.923230 tst cs_paging_gprs_active.py: using LAC 33412 10:47:02.058697 tst cs_paging_gprs_active.py: using RAC 7 10:47:02.194737 tst cs_paging_gprs_active.py: using CellId 33412 10:47:02.327344 tst cs_paging_gprs_active.py: using BVCI 33413 10:47:02.451043 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:02.462505 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:02.473920 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:02.485440 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:02.496879 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:02.508549 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:02.520359 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:02.531789 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:02.543015 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:47:02.661764 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:47:02.778097 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:47:02.985647 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:03.296170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10506): Launched 10:47:03.564308 run iperf3-srv_10.42.42.10(pid=10507): Launched 10:47:03.679421 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:47:03.885700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:04.196620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10508): Launched 10:47:04.467618 run iperf3-srv_10.42.42.10(pid=10509): Launched 10:47:04.583736 tst cs_paging_gprs_active.py:38: start network... 10:47:04.789257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:05.266558 run create_hlr_db(pid=10510): Launched 10:47:05.392872 bus /gobi_6: Setting Powered False 10:47:06.454821 run create_hlr_db(pid=10510): Terminated: ok {rc=0} 10:47:06.907038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10512): Launched 10:47:07.239471 run osmo-hlr_10.42.42.2(pid=10513): Launched 10:47:07.367579 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:07.944482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10515): Launched 10:47:08.277430 run osmo-stp_10.42.42.5(pid=10516): Launched 10:47:08.403852 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:08.974078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10518): Launched 10:47:09.100470 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:09.390227 run patchelf(pid=10519): Launched 10:47:09.574919 run osmo-stp_10.42.42.5(pid=10516): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10516)] 10:47:09.715483 run osmo-stp_10.42.42.5(pid=10516): stdout: | (launched: 2022-12-13_10:47:08.216166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:09.857258 run osmo-stp_10.42.42.5(pid=10516): stderr: | 20221213104708407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104708407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104708407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104708408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104708408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104708408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104708408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:09.999263 run osmo-stp_10.42.42.5(pid=10516): stdout: | (launched: 2022-12-13_10:47:08.216166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:10.135470 run osmo-stp_10.42.42.5(pid=10516): stderr: | 20221213104708407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104708407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104708407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104708408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104708408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104708408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104708408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:10.296411 run patchelf(pid=10519): Terminating (SIGINT) 10:47:10.483126 run patchelf(pid=10519): Terminated: ok {rc=0} 10:47:10.617435 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10516): Process ended prematurely: osmo-stp_10.42.42.5(pid=10516) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10516)] [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:47:10.627661 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:47:10.656286 run osmo-hlr_10.42.42.2(pid=10513): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10513)] 10:47:10.707713 run osmo-hlr_10.42.42.2(pid=10513): stdout: | (launched: 2022-12-13_10:47:07.178323) 10:47:10.760275 run osmo-hlr_10.42.42.2(pid=10513): stderr: | 20221213104707375 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104707375 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104707375 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104707375 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104707375 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104707375 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104707387 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104707397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104707397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104707397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:10.813495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10506): Terminating (SIGTERM) 10:47:10.856054 run iperf3-srv_10.42.42.10(pid=10507): Terminating (SIGTERM) 10:47:10.898624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10508): Terminating (SIGTERM) 10:47:10.941179 run iperf3-srv_10.42.42.10(pid=10509): Terminating (SIGTERM) 10:47:10.983951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10512): Terminating (SIGTERM) 10:47:11.026725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10515): Terminating (SIGTERM) 10:47:11.069333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10518): Terminating (SIGTERM) 10:47:11.112614 --- ParallelTerminationStrategy: PID 10506 died... 10:47:11.133674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10506): Terminated: ok {rc=0} 10:47:11.180899 --- ParallelTerminationStrategy: PID 10507 died... 10:47:11.201334 run iperf3-srv_10.42.42.10(pid=10507): Terminated {rc=256} 10:47:11.248321 --- ParallelTerminationStrategy: PID 10508 died... 10:47:11.268748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10508): Terminated: ok {rc=0} 10:47:11.315663 --- ParallelTerminationStrategy: PID 10509 died... 10:47:11.336041 run iperf3-srv_10.42.42.10(pid=10509): Terminated {rc=256} 10:47:11.382843 --- ParallelTerminationStrategy: PID 10512 died... 10:47:11.403452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10512): Terminated: ok {rc=0} 10:47:11.450284 --- ParallelTerminationStrategy: PID 10515 died... 10:47:11.470627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10515): Terminated: ok {rc=0} 10:47:11.517553 --- ParallelTerminationStrategy: PID 10518 died... 10:47:11.538066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10518): Terminated: ok {rc=0} 10:47:11.626877 bus /gobi_0: Setting Powered False 10:47:12.726756 bus /gobi_0: Setting Powered False 10:47:13.844928 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:47:14.996320 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:15.008399 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:47:15.081361 tst iperf3.py: using LAC 33413 10:47:15.212242 tst iperf3.py: using RAC 8 10:47:15.341344 tst iperf3.py: using CellId 33413 10:47:15.472518 tst iperf3.py: using BVCI 33414 10:47:15.592415 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:15.603811 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:15.614910 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:15.625998 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:15.637597 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:15.649231 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:15.660839 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:15.672349 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:15.683989 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:47:15.804171 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:47:16.046940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:16.364013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10520): Launched 10:47:16.653738 run iperf3-srv_10.42.42.10(pid=10521): Launched 10:47:16.791840 tst iperf3.py:8: start network... 10:47:17.022027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:17.543424 run create_hlr_db(pid=10522): Launched 10:47:17.669368 bus /gobi_6: Setting Powered False 10:47:18.734964 run create_hlr_db(pid=10522): Terminated: ok {rc=0} 10:47:19.174553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10524): Launched 10:47:19.482818 run osmo-hlr_10.42.42.2(pid=10525): Launched 10:47:19.600004 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:20.235916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10527): Launched 10:47:20.537621 run osmo-stp_10.42.42.5(pid=10528): Launched 10:47:20.652041 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:21.171003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10530): Launched 10:47:21.287390 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:21.543761 run patchelf(pid=10531): Launched 10:47:21.711082 run osmo-stp_10.42.42.5(pid=10528): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10528)] 10:47:21.838670 run osmo-stp_10.42.42.5(pid=10528): stdout: | (launched: 2022-12-13_10:47:20.481348) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:21.967326 run osmo-stp_10.42.42.5(pid=10528): stderr: | 20221213104720649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104720649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104720650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104720650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104720650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104720651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104720651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:22.096061 run osmo-stp_10.42.42.5(pid=10528): stdout: | (launched: 2022-12-13_10:47:20.481348) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:22.220455 run osmo-stp_10.42.42.5(pid=10528): stderr: | 20221213104720649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104720649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104720650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104720650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104720650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104720651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104720651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:22.366736 run patchelf(pid=10531): Terminating (SIGINT) 10:47:22.536105 run patchelf(pid=10531): Terminated: ok {rc=0} 10:47:22.658714 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10528): Process ended prematurely: osmo-stp_10.42.42.5(pid=10528) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10528)] [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 10:47:22.668634 tst iperf3.py:8: Test FAILED (7.7 sec) 10:47:22.695654 run osmo-hlr_10.42.42.2(pid=10525): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10525)] 10:47:22.743791 run osmo-hlr_10.42.42.2(pid=10525): stdout: | (launched: 2022-12-13_10:47:19.425284) 10:47:22.793260 run osmo-hlr_10.42.42.2(pid=10525): stderr: | 20221213104719602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104719602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104719602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104719602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104719602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104719602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104719614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104719625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104719626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104719626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:22.843179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10520): Terminating (SIGTERM) 10:47:22.883286 run iperf3-srv_10.42.42.10(pid=10521): Terminating (SIGTERM) 10:47:22.923086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10524): Terminating (SIGTERM) 10:47:22.962718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10527): Terminating (SIGTERM) 10:47:23.002144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10530): Terminating (SIGTERM) 10:47:23.041984 --- ParallelTerminationStrategy: PID 10520 died... 10:47:23.061251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10520): Terminated: ok {rc=0} 10:47:23.105500 --- ParallelTerminationStrategy: PID 10521 died... 10:47:23.124343 run iperf3-srv_10.42.42.10(pid=10521): Terminated {rc=256} 10:47:23.169087 --- ParallelTerminationStrategy: PID 10524 died... 10:47:23.187841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10524): Terminated: ok {rc=0} 10:47:23.231562 --- ParallelTerminationStrategy: PID 10527 died... 10:47:23.250287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10527): Terminated: ok {rc=0} 10:47:23.294091 --- ParallelTerminationStrategy: PID 10530 died... 10:47:23.312837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10530): Terminated: ok {rc=0} 10:47:23.396939 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:47:24.546684 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:24.558843 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:47:24.630834 tst iperf3m4.py: using LAC 33414 10:47:24.755296 tst iperf3m4.py: using RAC 9 10:47:24.881389 tst iperf3m4.py: using CellId 33414 10:47:25.007771 tst iperf3m4.py: using BVCI 33415 10:47:25.120131 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:25.131447 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:25.142752 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:25.154048 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:25.165670 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:25.176144 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:25.186810 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:25.197310 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:25.208059 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:47:25.328848 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:47:25.448474 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:47:25.568901 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:47:25.689115 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:47:25.891858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:26.195838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10532): Launched 10:47:26.460727 run iperf3-srv_10.42.42.10(pid=10533): Launched 10:47:26.574145 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:47:26.775748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:27.080002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10534): Launched 10:47:27.344039 run iperf3-srv_10.42.42.10(pid=10535): Launched 10:47:27.456281 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:47:27.658026 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:27.962789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10536): Launched 10:47:28.225664 run iperf3-srv_10.42.42.10(pid=10537): Launched 10:47:28.338790 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:47:28.539531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:28.842988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10538): Launched 10:47:29.108863 run iperf3-srv_10.42.42.10(pid=10539): Launched 10:47:29.221402 tst iperf3m4.py:8: start network... 10:47:29.422491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:29.892847 run create_hlr_db(pid=10540): Launched 10:47:30.016347 bus /gobi_6: Setting Powered False 10:47:31.080136 run create_hlr_db(pid=10540): Terminated: ok {rc=0} 10:47:31.542400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10542): Launched 10:47:31.885632 run osmo-hlr_10.42.42.2(pid=10543): Launched 10:47:32.136088 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:32.681330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10545): Launched 10:47:32.984517 run osmo-stp_10.42.42.5(pid=10546): Launched 10:47:33.098161 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:33.620034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10548): Launched 10:47:33.735032 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:33.990847 run patchelf(pid=10549): Launched 10:47:34.159793 run osmo-stp_10.42.42.5(pid=10546): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10546)] 10:47:34.287727 run osmo-stp_10.42.42.5(pid=10546): stdout: | (launched: 2022-12-13_10:47:32.928090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:34.416861 run osmo-stp_10.42.42.5(pid=10546): stderr: | 20221213104733096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104733096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104733096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104733097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104733097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104733097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104733097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:34.546040 run osmo-stp_10.42.42.5(pid=10546): stdout: | (launched: 2022-12-13_10:47:32.928090) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:34.669434 run osmo-stp_10.42.42.5(pid=10546): stderr: | 20221213104733096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104733096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104733096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104733097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104733097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104733097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104733097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:34.815716 run patchelf(pid=10549): Terminating (SIGINT) 10:47:34.985418 run patchelf(pid=10549): Terminated: ok {rc=0} 10:47:35.107408 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10546): Process ended prematurely: osmo-stp_10.42.42.5(pid=10546) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10546)] [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:47:35.117104 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:47:35.144177 run osmo-hlr_10.42.42.2(pid=10543): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10543)] 10:47:35.192383 run osmo-hlr_10.42.42.2(pid=10543): stdout: | (launched: 2022-12-13_10:47:31.825108) 10:47:35.242451 run osmo-hlr_10.42.42.2(pid=10543): stderr: | 20221213104732056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104732056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104732056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104732056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104732056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104732056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104732070 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104732080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104732080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104732080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:35.292532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10532): Terminating (SIGTERM) 10:47:35.332738 run iperf3-srv_10.42.42.10(pid=10533): Terminating (SIGTERM) 10:47:35.372731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10534): Terminating (SIGTERM) 10:47:35.412445 run iperf3-srv_10.42.42.10(pid=10535): Terminating (SIGTERM) 10:47:35.452165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10536): Terminating (SIGTERM) 10:47:35.491879 run iperf3-srv_10.42.42.10(pid=10537): Terminating (SIGTERM) 10:47:35.531560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10538): Terminating (SIGTERM) 10:47:35.571353 run iperf3-srv_10.42.42.10(pid=10539): Terminating (SIGTERM) 10:47:35.611134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10542): Terminating (SIGTERM) 10:47:35.651030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10545): Terminating (SIGTERM) 10:47:35.690711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10548): Terminating (SIGTERM) 10:47:35.730742 --- ParallelTerminationStrategy: PID 10532 died... 10:47:35.749991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10532): Terminated: ok {rc=0} 10:47:35.793980 --- ParallelTerminationStrategy: PID 10533 died... 10:47:35.812556 run iperf3-srv_10.42.42.10(pid=10533): Terminated {rc=256} 10:47:35.856141 --- ParallelTerminationStrategy: PID 10534 died... 10:47:35.874622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10534): Terminated: ok {rc=0} 10:47:35.918322 --- ParallelTerminationStrategy: PID 10535 died... 10:47:35.936763 run iperf3-srv_10.42.42.10(pid=10535): Terminated {rc=256} 10:47:35.980400 --- ParallelTerminationStrategy: PID 10536 died... 10:47:35.999053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10536): Terminated: ok {rc=0} 10:47:36.042736 --- ParallelTerminationStrategy: PID 10537 died... 10:47:36.061310 run iperf3-srv_10.42.42.10(pid=10537): Terminated {rc=256} 10:47:36.104827 --- ParallelTerminationStrategy: PID 10538 died... 10:47:36.124011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10538): Terminated: ok {rc=0} 10:47:36.167711 --- ParallelTerminationStrategy: PID 10539 died... 10:47:36.186187 run iperf3-srv_10.42.42.10(pid=10539): Terminated {rc=256} 10:47:36.229671 --- ParallelTerminationStrategy: PID 10542 died... 10:47:36.248269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10542): Terminated: ok {rc=0} 10:47:36.291906 --- ParallelTerminationStrategy: PID 10545 died... 10:47:36.310890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10545): Terminated: ok {rc=0} 10:47:36.354977 --- ParallelTerminationStrategy: PID 10548 died... 10:47:36.373705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10548): Terminated: ok {rc=0} 10:47:36.459611 bus /gobi_4: Setting Powered False 10:47:37.560422 bus /gobi_4: Setting Powered False 10:47:38.680054 bus /gobi_1: Setting Powered False 10:47:39.780243 bus /gobi_1: Setting Powered False 10:47:40.895783 bus /gobi_0: Setting Powered False 10:47:41.995442 bus /gobi_0: Setting Powered False 10:47:43.111739 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:47:44.215573 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:44.226966 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:47:44.295292 tst ping.py: using LAC 33415 10:47:44.415750 tst ping.py: using RAC 10 10:47:44.532677 tst ping.py: using CellId 33415 10:47:44.647724 tst ping.py: using BVCI 33416 10:47:44.755172 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:44.766446 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:44.777108 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:44.787666 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:44.798286 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:44.808849 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:44.819596 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:44.830129 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:47:44.949070 tst ping.py:19: start network... 10:47:45.163620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:45.658977 run create_hlr_db(pid=10550): Launched 10:47:45.780657 bus /gobi_6: Setting Powered False 10:47:46.843161 run create_hlr_db(pid=10550): Terminated: ok {rc=0} 10:47:47.304073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10552): Launched 10:47:47.603392 run osmo-hlr_10.42.42.2(pid=10553): Launched 10:47:47.715787 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:48.228401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10555): Launched 10:47:48.527671 run osmo-stp_10.42.42.5(pid=10556): Launched 10:47:48.640691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:49.155027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10558): Launched 10:47:49.269836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:49.522722 run patchelf(pid=10559): Launched 10:47:49.689157 run osmo-stp_10.42.42.5(pid=10556): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10556)] 10:47:49.814711 run osmo-stp_10.42.42.5(pid=10556): stdout: | (launched: 2022-12-13_10:47:48.471889) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:49.941548 run osmo-stp_10.42.42.5(pid=10556): stderr: | 20221213104748638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104748639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104748639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104748639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104748640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104748640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104748640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:50.068530 run osmo-stp_10.42.42.5(pid=10556): stdout: | (launched: 2022-12-13_10:47:48.471889) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:50.190205 run osmo-stp_10.42.42.5(pid=10556): stderr: | 20221213104748638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104748639 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104748639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104748639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104748640 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104748640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104748640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:50.334449 run patchelf(pid=10559): Terminating (SIGINT) 10:47:50.502786 run patchelf(pid=10559): Terminated: ok {rc=0} 10:47:50.623608 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10556): Process ended prematurely: osmo-stp_10.42.42.5(pid=10556) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10556)] [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 10:47:50.632495 tst ping.py:22: Test FAILED (6.4 sec) 10:47:50.659095 run osmo-hlr_10.42.42.2(pid=10553): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10553)] 10:47:50.707308 run osmo-hlr_10.42.42.2(pid=10553): stdout: | (launched: 2022-12-13_10:47:47.546937) 10:47:50.757139 run osmo-hlr_10.42.42.2(pid=10553): stderr: | 20221213104747722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104747722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104747722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104747722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104747722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104747722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104747737 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104747747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104747748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104747748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:50.807017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10552): Terminating (SIGTERM) 10:47:50.846866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10555): Terminating (SIGTERM) 10:47:50.886743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10558): Terminating (SIGTERM) 10:47:50.927025 --- ParallelTerminationStrategy: PID 10552 died... 10:47:50.946223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10552): Terminated: ok {rc=0} 10:47:50.990681 --- ParallelTerminationStrategy: PID 10555 died... 10:47:51.009393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10555): Terminated: ok {rc=0} 10:47:51.053209 --- ParallelTerminationStrategy: PID 10558 died... 10:47:51.071806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10558): Terminated: ok {rc=0} 10:47:51.155018 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:47:52.243234 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:52.255699 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:47:52.329381 tst ping_idle_ping.py: using LAC 33416 10:47:52.452537 tst ping_idle_ping.py: using RAC 11 10:47:52.573805 tst ping_idle_ping.py: using CellId 33416 10:47:52.690353 tst ping_idle_ping.py: using BVCI 33417 10:47:52.798422 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:52.809265 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:52.819867 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:52.830584 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:52.841128 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:52.852229 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:52.863484 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:52.874593 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:47:52.994763 tst ping_idle_ping.py:24: start network... 10:47:53.210923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:53.706408 run create_hlr_db(pid=10560): Launched 10:47:53.827915 bus /gobi_6: Setting Powered False 10:47:54.891835 run create_hlr_db(pid=10560): Terminated: ok {rc=0} 10:47:55.319942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10562): Launched 10:47:55.619535 run osmo-hlr_10.42.42.2(pid=10563): Launched 10:47:55.736253 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:56.263394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10565): Launched 10:47:56.565276 run osmo-stp_10.42.42.5(pid=10566): Launched 10:47:56.677867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:57.191617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10568): Launched 10:47:57.305166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:57.558007 run patchelf(pid=10569): Launched 10:47:57.724249 run osmo-stp_10.42.42.5(pid=10566): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10566)] 10:47:57.850980 run osmo-stp_10.42.42.5(pid=10566): stdout: | (launched: 2022-12-13_10:47:56.509374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:57.978897 run osmo-stp_10.42.42.5(pid=10566): stderr: | 20221213104756677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104756677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104756678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104756678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104756679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104756679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104756679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:58.107201 run osmo-stp_10.42.42.5(pid=10566): stdout: | (launched: 2022-12-13_10:47:56.509374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:58.229805 run osmo-stp_10.42.42.5(pid=10566): stderr: | 20221213104756677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104756677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104756678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104756678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104756679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104756679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104756679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:58.374812 run patchelf(pid=10569): Terminating (SIGINT) 10:47:58.543976 run patchelf(pid=10569): Terminated: ok {rc=0} 10:47:58.665446 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10566): Process ended prematurely: osmo-stp_10.42.42.5(pid=10566) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10566)] [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:47:58.674324 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:47:58.700841 run osmo-hlr_10.42.42.2(pid=10563): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10563)] 10:47:58.748861 run osmo-hlr_10.42.42.2(pid=10563): stdout: | (launched: 2022-12-13_10:47:55.563933) 10:47:58.798608 run osmo-hlr_10.42.42.2(pid=10563): stderr: | 20221213104755738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104755738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104755738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104755738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104755738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104755738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104755750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104755760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104755760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104755760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:58.848530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10562): Terminating (SIGTERM) 10:47:58.888806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10565): Terminating (SIGTERM) 10:47:58.928459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10568): Terminating (SIGTERM) 10:47:58.968245 --- ParallelTerminationStrategy: PID 10562 died... 10:47:58.987419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10562): Terminated: ok {rc=0} 10:47:59.031680 --- ParallelTerminationStrategy: PID 10565 died... 10:47:59.050404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10565): Terminated: ok {rc=0} 10:47:59.094584 --- ParallelTerminationStrategy: PID 10568 died... 10:47:59.113348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10568): Terminated: ok {rc=0} 10:47:59.199365 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:48:00.504207 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:48:00.510369 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:48:00.542215 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:48:00.585833 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:48:00.674790 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:48:00.707636 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:48:00.747026 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:48:01.372044 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:48:01.423490 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:01.434878 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:48:01.503850 tst cs_paging_gprs_active.py: using LAC 33417 10:48:01.670036 tst cs_paging_gprs_active.py: using RAC 12 10:48:01.843479 tst cs_paging_gprs_active.py: using CellId 33417 10:48:01.975609 tst cs_paging_gprs_active.py: using BVCI 33418 10:48:02.097474 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.109995 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.122402 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.135040 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.148318 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.161328 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.174770 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.188215 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.201527 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:48:02.328161 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:48:02.453766 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:48:02.674678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:03.002588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10576): Launched 10:48:03.288806 run iperf3-srv_10.42.42.10(pid=10577): Launched 10:48:03.411444 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:48:03.631585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:03.959836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10578): Launched 10:48:04.245618 run iperf3-srv_10.42.42.10(pid=10579): Launched 10:48:04.369490 tst cs_paging_gprs_active.py:38: start network... 10:48:04.588879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:05.093606 run create_hlr_db(pid=10580): Launched 10:48:05.221660 bus /gobi_6: Setting Powered False 10:48:06.282701 run create_hlr_db(pid=10580): Terminated: ok {rc=0} 10:48:06.707160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10582): Launched 10:48:07.011431 run osmo-hlr_10.42.42.2(pid=10583): Launched 10:48:07.128739 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:07.651539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10585): Launched 10:48:07.956173 run osmo-stp_10.42.42.5(pid=10586): Launched 10:48:08.073792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:08.599425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10588): Launched 10:48:08.715216 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:08.974419 run patchelf(pid=10589): Launched 10:48:09.142961 run osmo-stp_10.42.42.5(pid=10586): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10586)] 10:48:09.271092 run osmo-stp_10.42.42.5(pid=10586): stdout: | (launched: 2022-12-13_10:48:07.899079) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:09.400619 run osmo-stp_10.42.42.5(pid=10586): stderr: | 20221213104808066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104808066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104808066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104808067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104808067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104808067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104808067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:09.530196 run osmo-stp_10.42.42.5(pid=10586): stdout: | (launched: 2022-12-13_10:48:07.899079) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:09.654533 run osmo-stp_10.42.42.5(pid=10586): stderr: | 20221213104808066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104808066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104808066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104808067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104808067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104808067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104808067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:09.802156 run patchelf(pid=10589): Terminating (SIGINT) 10:48:09.972645 run patchelf(pid=10589): Terminated: ok {rc=0} 10:48:10.095529 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10586): Process ended prematurely: osmo-stp_10.42.42.5(pid=10586) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10586)] [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:48:10.105088 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:48:10.132063 run osmo-hlr_10.42.42.2(pid=10583): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10583)] 10:48:10.179543 run osmo-hlr_10.42.42.2(pid=10583): stdout: | (launched: 2022-12-13_10:48:06.954848) 10:48:10.228793 run osmo-hlr_10.42.42.2(pid=10583): stderr: | 20221213104807127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104807128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104807128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104807128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104807128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104807128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104807140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104807148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104807149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104807149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:10.278568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10576): Terminating (SIGTERM) 10:48:10.318091 run iperf3-srv_10.42.42.10(pid=10577): Terminating (SIGTERM) 10:48:10.357485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10578): Terminating (SIGTERM) 10:48:10.397044 run iperf3-srv_10.42.42.10(pid=10579): Terminating (SIGTERM) 10:48:10.436262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10582): Terminating (SIGTERM) 10:48:10.475872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10585): Terminating (SIGTERM) 10:48:10.515340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10588): Terminating (SIGTERM) 10:48:10.554993 --- ParallelTerminationStrategy: PID 10576 died... 10:48:10.574438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10576): Terminated: ok {rc=0} 10:48:10.618467 --- ParallelTerminationStrategy: PID 10577 died... 10:48:10.636693 run iperf3-srv_10.42.42.10(pid=10577): Terminated {rc=256} 10:48:10.680136 --- ParallelTerminationStrategy: PID 10578 died... 10:48:10.698590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10578): Terminated: ok {rc=0} 10:48:10.741996 --- ParallelTerminationStrategy: PID 10579 died... 10:48:10.760324 run iperf3-srv_10.42.42.10(pid=10579): Terminated {rc=256} 10:48:10.803581 --- ParallelTerminationStrategy: PID 10582 died... 10:48:10.822196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10582): Terminated: ok {rc=0} 10:48:10.865650 --- ParallelTerminationStrategy: PID 10585 died... 10:48:10.884142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10585): Terminated: ok {rc=0} 10:48:10.927708 --- ParallelTerminationStrategy: PID 10588 died... 10:48:10.946232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10588): Terminated: ok {rc=0} 10:48:11.032141 bus /gobi_0: Setting Powered False 10:48:12.132298 bus /gobi_0: Setting Powered False 10:48:13.249689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:48:14.396545 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:14.408156 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:48:14.477463 tst iperf3.py: using LAC 33418 10:48:14.597800 tst iperf3.py: using RAC 13 10:48:14.727732 tst iperf3.py: using CellId 33418 10:48:14.849193 tst iperf3.py: using BVCI 33419 10:48:14.959799 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:14.970673 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:14.981336 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:14.991891 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:15.002523 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:15.013158 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:15.023850 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:15.034466 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:15.045194 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:48:15.163127 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:48:15.382955 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:15.709660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10590): Launched 10:48:15.996691 run iperf3-srv_10.42.42.10(pid=10591): Launched 10:48:16.136713 tst iperf3.py:8: start network... 10:48:16.346108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:16.836173 run create_hlr_db(pid=10592): Launched 10:48:16.989255 bus /gobi_6: Setting Powered False 10:48:18.049986 run create_hlr_db(pid=10592): Terminated: ok {rc=0} 10:48:18.473393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10594): Launched 10:48:18.777248 run osmo-hlr_10.42.42.2(pid=10595): Launched 10:48:18.891612 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:19.420938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10597): Launched 10:48:19.726239 run osmo-stp_10.42.42.5(pid=10598): Launched 10:48:19.841066 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:20.364832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10600): Launched 10:48:20.480815 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:20.739308 run patchelf(pid=10601): Launched 10:48:20.909525 run osmo-stp_10.42.42.5(pid=10598): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10598)] 10:48:21.037837 run osmo-stp_10.42.42.5(pid=10598): stdout: | (launched: 2022-12-13_10:48:19.668655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:21.167679 run osmo-stp_10.42.42.5(pid=10598): stderr: | 20221213104819839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104819839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104819840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104819840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104819840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104819841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104819841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:21.297338 run osmo-stp_10.42.42.5(pid=10598): stdout: | (launched: 2022-12-13_10:48:19.668655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:21.421398 run osmo-stp_10.42.42.5(pid=10598): stderr: | 20221213104819839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104819839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104819840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104819840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104819840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104819841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104819841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:21.568463 run patchelf(pid=10601): Terminating (SIGINT) 10:48:21.739418 run patchelf(pid=10601): Terminated: ok {rc=0} 10:48:21.862628 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10598): Process ended prematurely: osmo-stp_10.42.42.5(pid=10598) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10598)] [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 10:48:21.872085 tst iperf3.py:8: Test FAILED (7.5 sec) 10:48:21.899304 run osmo-hlr_10.42.42.2(pid=10595): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10595)] 10:48:21.947309 run osmo-hlr_10.42.42.2(pid=10595): stdout: | (launched: 2022-12-13_10:48:18.720776) 10:48:21.997243 run osmo-hlr_10.42.42.2(pid=10595): stderr: | 20221213104818894 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104818894 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104818894 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104818894 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104818894 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104818894 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104818907 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104818916 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104818916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104818916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:22.047565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10590): Terminating (SIGTERM) 10:48:22.087943 run iperf3-srv_10.42.42.10(pid=10591): Terminating (SIGTERM) 10:48:22.128483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10594): Terminating (SIGTERM) 10:48:22.168550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10597): Terminating (SIGTERM) 10:48:22.208280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10600): Terminating (SIGTERM) 10:48:22.248366 --- ParallelTerminationStrategy: PID 10590 died... 10:48:22.267580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10590): Terminated: ok {rc=0} 10:48:22.311527 --- ParallelTerminationStrategy: PID 10591 died... 10:48:22.330076 run iperf3-srv_10.42.42.10(pid=10591): Terminated {rc=256} 10:48:22.373806 --- ParallelTerminationStrategy: PID 10594 died... 10:48:22.392551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10594): Terminated: ok {rc=0} 10:48:22.436467 --- ParallelTerminationStrategy: PID 10597 died... 10:48:22.455226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10597): Terminated: ok {rc=0} 10:48:22.499122 --- ParallelTerminationStrategy: PID 10600 died... 10:48:22.518007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10600): Terminated: ok {rc=0} 10:48:22.601563 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:48:23.751988 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:23.763981 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:48:23.836313 tst iperf3m4.py: using LAC 33419 10:48:23.964027 tst iperf3m4.py: using RAC 14 10:48:24.090684 tst iperf3m4.py: using CellId 33419 10:48:24.218120 tst iperf3m4.py: using BVCI 33420 10:48:24.337113 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:24.348498 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:24.359750 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:24.370959 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:24.382378 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:24.393955 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:24.405530 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:24.416801 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:24.428588 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:48:24.545558 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:48:24.668357 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:48:24.785522 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:48:24.901825 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:48:25.104418 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:25.409242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10602): Launched 10:48:25.674021 run iperf3-srv_10.42.42.10(pid=10603): Launched 10:48:25.788577 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:48:25.990189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:26.294545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10604): Launched 10:48:26.561142 run iperf3-srv_10.42.42.10(pid=10605): Launched 10:48:26.674483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:48:26.877359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:27.182561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10606): Launched 10:48:27.448126 run iperf3-srv_10.42.42.10(pid=10607): Launched 10:48:27.561235 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:48:27.763039 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:48:28.068097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10608): Launched 10:48:28.333610 run iperf3-srv_10.42.42.10(pid=10609): Launched 10:48:28.447910 tst iperf3m4.py:8: start network... 10:48:28.649811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:29.121367 run create_hlr_db(pid=10610): Launched 10:48:29.245962 bus /gobi_6: Setting Powered False 10:48:30.307008 run create_hlr_db(pid=10610): Terminated: ok {rc=0} 10:48:30.751561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10612): Launched 10:48:31.097614 run osmo-hlr_10.42.42.2(pid=10613): Launched 10:48:31.412460 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:32.012304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10615): Launched 10:48:32.344229 run osmo-stp_10.42.42.5(pid=10616): Launched 10:48:32.563051 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:33.087778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10618): Launched 10:48:33.205253 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:33.463233 run patchelf(pid=10619): Launched 10:48:33.633782 run osmo-stp_10.42.42.5(pid=10616): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10616)] 10:48:33.762230 run osmo-stp_10.42.42.5(pid=10616): stdout: | (launched: 2022-12-13_10:48:32.281296) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:33.892591 run osmo-stp_10.42.42.5(pid=10616): stderr: | 20221213104832466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104832466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104832466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104832467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104832467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104832467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104832467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:34.022638 run osmo-stp_10.42.42.5(pid=10616): stdout: | (launched: 2022-12-13_10:48:32.281296) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:34.147208 run osmo-stp_10.42.42.5(pid=10616): stderr: | 20221213104832466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104832466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104832466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104832467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104832467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104832467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104832467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:34.294805 run patchelf(pid=10619): Terminating (SIGINT) 10:48:34.465108 run patchelf(pid=10619): Terminated: ok {rc=0} 10:48:34.588049 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10616): Process ended prematurely: osmo-stp_10.42.42.5(pid=10616) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10616)] [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:48:34.597629 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:48:34.625251 run osmo-hlr_10.42.42.2(pid=10613): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10613)] 10:48:34.673270 run osmo-hlr_10.42.42.2(pid=10613): stdout: | (launched: 2022-12-13_10:48:31.026746) 10:48:34.723118 run osmo-hlr_10.42.42.2(pid=10613): stderr: | 20221213104831353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104831353 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104831354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104831354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104831356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104831356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104831381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104831404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104831405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104831405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:34.774374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10602): Terminating (SIGTERM) 10:48:34.814383 run iperf3-srv_10.42.42.10(pid=10603): Terminating (SIGTERM) 10:48:34.854065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10604): Terminating (SIGTERM) 10:48:34.893513 run iperf3-srv_10.42.42.10(pid=10605): Terminating (SIGTERM) 10:48:34.932875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10606): Terminating (SIGTERM) 10:48:34.973070 run iperf3-srv_10.42.42.10(pid=10607): Terminating (SIGTERM) 10:48:35.012803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10608): Terminating (SIGTERM) 10:48:35.052518 run iperf3-srv_10.42.42.10(pid=10609): Terminating (SIGTERM) 10:48:35.092097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10612): Terminating (SIGTERM) 10:48:35.131874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10615): Terminating (SIGTERM) 10:48:35.171559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10618): Terminating (SIGTERM) 10:48:35.211703 --- ParallelTerminationStrategy: PID 10602 died... 10:48:35.230920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10602): Terminated: ok {rc=0} 10:48:35.275035 --- ParallelTerminationStrategy: PID 10603 died... 10:48:35.293706 run iperf3-srv_10.42.42.10(pid=10603): Terminated {rc=256} 10:48:35.337625 --- ParallelTerminationStrategy: PID 10604 died... 10:48:35.356250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10604): Terminated: ok {rc=0} 10:48:35.400335 --- ParallelTerminationStrategy: PID 10605 died... 10:48:35.419090 run iperf3-srv_10.42.42.10(pid=10605): Terminated {rc=256} 10:48:35.462949 --- ParallelTerminationStrategy: PID 10606 died... 10:48:35.481623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10606): Terminated: ok {rc=0} 10:48:35.525732 --- ParallelTerminationStrategy: PID 10607 died... 10:48:35.544286 run iperf3-srv_10.42.42.10(pid=10607): Terminated {rc=256} 10:48:35.588662 --- ParallelTerminationStrategy: PID 10608 died... 10:48:35.607509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10608): Terminated: ok {rc=0} 10:48:35.651630 --- ParallelTerminationStrategy: PID 10609 died... 10:48:35.670395 run iperf3-srv_10.42.42.10(pid=10609): Terminated {rc=256} 10:48:35.714339 --- ParallelTerminationStrategy: PID 10612 died... 10:48:35.733061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10612): Terminated: ok {rc=0} 10:48:35.776817 --- ParallelTerminationStrategy: PID 10615 died... 10:48:35.795981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10615): Terminated: ok {rc=0} 10:48:35.839990 --- ParallelTerminationStrategy: PID 10618 died... 10:48:35.858823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10618): Terminated: ok {rc=0} 10:48:35.944412 bus /gobi_4: Setting Powered False 10:48:37.045214 bus /gobi_4: Setting Powered False 10:48:38.162953 bus /gobi_1: Setting Powered False 10:48:39.263431 bus /gobi_1: Setting Powered False 10:48:40.379198 bus /gobi_0: Setting Powered False 10:48:41.478303 bus /gobi_0: Setting Powered False 10:48:42.595731 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:48:43.702134 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:43.714241 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:48:43.786603 tst ping.py: using LAC 33420 10:48:43.912114 tst ping.py: using RAC 15 10:48:44.037139 tst ping.py: using CellId 33420 10:48:44.163907 tst ping.py: using BVCI 33421 10:48:44.273950 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:44.284846 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:44.295770 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:44.306768 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:44.317908 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:44.328752 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:44.339763 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:44.350656 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:48:44.469050 tst ping.py:19: start network... 10:48:44.683037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:45.180449 run create_hlr_db(pid=10620): Launched 10:48:45.302369 bus /gobi_6: Setting Powered False 10:48:46.362541 run create_hlr_db(pid=10620): Terminated: ok {rc=0} 10:48:46.802715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10622): Launched 10:48:47.125718 run osmo-hlr_10.42.42.2(pid=10623): Launched 10:48:47.279598 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:47.834720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10625): Launched 10:48:48.155425 run osmo-stp_10.42.42.5(pid=10626): Launched 10:48:48.278485 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:48.827812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10628): Launched 10:48:48.950881 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:49.221423 run patchelf(pid=10629): Launched 10:48:49.398914 run osmo-stp_10.42.42.5(pid=10626): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10626)] 10:48:49.533702 run osmo-stp_10.42.42.5(pid=10626): stdout: | (launched: 2022-12-13_10:48:48.096293) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:49.670202 run osmo-stp_10.42.42.5(pid=10626): stderr: | 20221213104848285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104848286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104848286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104848286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104848287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104848287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104848287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:49.806725 run osmo-stp_10.42.42.5(pid=10626): stdout: | (launched: 2022-12-13_10:48:48.096293) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:49.937074 run osmo-stp_10.42.42.5(pid=10626): stderr: | 20221213104848285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104848286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104848286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104848286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104848287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104848287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104848287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:50.091574 run patchelf(pid=10629): Terminating (SIGINT) 10:48:50.271381 run patchelf(pid=10629): Terminated: ok {rc=0} 10:48:50.400614 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10626): Process ended prematurely: osmo-stp_10.42.42.5(pid=10626) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10626)] [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 10:48:50.410313 tst ping.py:22: Test FAILED (6.7 sec) 10:48:50.439032 run osmo-hlr_10.42.42.2(pid=10623): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10623)] 10:48:50.490309 run osmo-hlr_10.42.42.2(pid=10623): stdout: | (launched: 2022-12-13_10:48:47.067448) 10:48:50.543169 run osmo-hlr_10.42.42.2(pid=10623): stderr: | 20221213104847315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104847315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104847315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104847315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104847315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104847315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104847327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104847336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104847336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104847336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:50.596606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10622): Terminating (SIGTERM) 10:48:50.639468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10625): Terminating (SIGTERM) 10:48:50.682273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10628): Terminating (SIGTERM) 10:48:50.725343 --- ParallelTerminationStrategy: PID 10622 died... 10:48:50.746042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10622): Terminated: ok {rc=0} 10:48:50.792907 --- ParallelTerminationStrategy: PID 10625 died... 10:48:50.813142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10625): Terminated: ok {rc=0} 10:48:50.860028 --- ParallelTerminationStrategy: PID 10628 died... 10:48:50.880157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10628): Terminated: ok {rc=0} 10:48:50.970551 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:48:52.059436 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:52.071368 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:48:52.147598 tst ping_idle_ping.py: using LAC 33421 10:48:52.274713 tst ping_idle_ping.py: using RAC 16 10:48:52.401822 tst ping_idle_ping.py: using CellId 33421 10:48:52.526733 tst ping_idle_ping.py: using BVCI 33422 10:48:52.643086 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:52.654504 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:52.665820 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:52.676898 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:52.688021 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:52.699982 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:52.712100 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:52.724144 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:48:52.843523 tst ping_idle_ping.py:24: start network... 10:48:53.059946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:53.559806 run create_hlr_db(pid=10630): Launched 10:48:53.683210 bus /gobi_6: Setting Powered False 10:48:54.746905 run create_hlr_db(pid=10630): Terminated: ok {rc=0} 10:48:55.179372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10632): Launched 10:48:55.480246 run osmo-hlr_10.42.42.2(pid=10633): Launched 10:48:55.595016 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:56.110406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10635): Launched 10:48:56.411878 run osmo-stp_10.42.42.5(pid=10636): Launched 10:48:56.527217 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:57.046507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10638): Launched 10:48:57.161673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:57.415549 run patchelf(pid=10639): Launched 10:48:57.583257 run osmo-stp_10.42.42.5(pid=10636): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10636)] 10:48:57.710958 run osmo-stp_10.42.42.5(pid=10636): stdout: | (launched: 2022-12-13_10:48:56.355814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:57.839837 run osmo-stp_10.42.42.5(pid=10636): stderr: | 20221213104856523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104856523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104856524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104856524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104856524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104856525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104856525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:57.968669 run osmo-stp_10.42.42.5(pid=10636): stdout: | (launched: 2022-12-13_10:48:56.355814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:58.091877 run osmo-stp_10.42.42.5(pid=10636): stderr: | 20221213104856523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104856523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104856524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104856524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104856524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104856525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104856525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:58.237678 run patchelf(pid=10639): Terminating (SIGINT) 10:48:58.406846 run patchelf(pid=10639): Terminated: ok {rc=0} 10:48:58.528774 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10636): Process ended prematurely: osmo-stp_10.42.42.5(pid=10636) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10636)] [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:48:58.537885 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:48:58.564795 run osmo-hlr_10.42.42.2(pid=10633): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10633)] 10:48:58.612770 run osmo-hlr_10.42.42.2(pid=10633): stdout: | (launched: 2022-12-13_10:48:55.423863) 10:48:58.662364 run osmo-hlr_10.42.42.2(pid=10633): stderr: | 20221213104855598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104855598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104855598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104855598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104855598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104855598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104855611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104855620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104855620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104855620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:58.712544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10632): Terminating (SIGTERM) 10:48:58.752316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10635): Terminating (SIGTERM) 10:48:58.792288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10638): Terminating (SIGTERM) 10:48:58.832624 --- ParallelTerminationStrategy: PID 10632 died... 10:48:58.851965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10632): Terminated: ok {rc=0} 10:48:58.896379 --- ParallelTerminationStrategy: PID 10635 died... 10:48:58.915090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10635): Terminated: ok {rc=0} 10:48:58.959638 --- ParallelTerminationStrategy: PID 10638 died... 10:48:58.978768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10638): Terminated: ok {rc=0} 10:48:59.062877 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:49:00.363631 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:49:00.372728 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:49:00.406138 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 10:49:00.447003 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 10:49:00.535867 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:49:00.570123 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 10:49:00.609442 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 10:49:01.261566 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 10:49:01.318875 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:01.331487 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:49:01.386428 tst cs_paging_gprs_active.py: using LAC 33422 10:49:01.515726 tst cs_paging_gprs_active.py: using RAC 17 10:49:01.638829 tst cs_paging_gprs_active.py: using CellId 33422 10:49:01.786621 tst cs_paging_gprs_active.py: using BVCI 33423 10:49:01.901339 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:01.913594 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:01.925855 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:01.938304 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:01.951238 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:01.964926 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:01.978913 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:01.992006 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:02.004396 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:49:02.128429 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:49:02.259835 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:49:02.484015 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:02.813719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10643): Launched 10:49:03.097600 run iperf3-srv_10.42.42.10(pid=10644): Launched 10:49:03.219650 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:49:03.438728 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:03.766563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10645): Launched 10:49:04.050359 run iperf3-srv_10.42.42.10(pid=10646): Launched 10:49:04.172522 tst cs_paging_gprs_active.py:38: start network... 10:49:04.392386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:04.898833 run create_hlr_db(pid=10647): Launched 10:49:05.022657 bus /gobi_6: Setting Powered False 10:49:06.083637 run create_hlr_db(pid=10647): Terminated: ok {rc=0} 10:49:06.539841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10649): Launched 10:49:06.868565 run osmo-hlr_10.42.42.2(pid=10650): Launched 10:49:06.994076 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:07.557685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10652): Launched 10:49:07.883336 run osmo-stp_10.42.42.5(pid=10653): Launched 10:49:08.008736 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:08.571567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10655): Launched 10:49:08.698076 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:08.975489 run patchelf(pid=10656): Launched 10:49:09.157117 run osmo-stp_10.42.42.5(pid=10653): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10653)] 10:49:09.296072 run osmo-stp_10.42.42.5(pid=10653): stdout: | (launched: 2022-12-13_10:49:07.823306) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:09.435957 run osmo-stp_10.42.42.5(pid=10653): stderr: | 20221213104908014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104908015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104908015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104908015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104908016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104908016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104908016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:09.576001 run osmo-stp_10.42.42.5(pid=10653): stdout: | (launched: 2022-12-13_10:49:07.823306) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:09.710218 run osmo-stp_10.42.42.5(pid=10653): stderr: | 20221213104908014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104908015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104908015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104908015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104908016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104908016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104908016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:09.869208 run patchelf(pid=10656): Terminating (SIGINT) 10:49:10.052860 run patchelf(pid=10656): Terminated: ok {rc=0} 10:49:10.186103 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10653): Process ended prematurely: osmo-stp_10.42.42.5(pid=10653) [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10653)] [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 10:49:10.196368 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 10:49:10.225392 run osmo-hlr_10.42.42.2(pid=10650): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10650)] 10:49:10.277206 run osmo-hlr_10.42.42.2(pid=10650): stdout: | (launched: 2022-12-13_10:49:06.808153) 10:49:10.330632 run osmo-hlr_10.42.42.2(pid=10650): stderr: | 20221213104907007 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104907007 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104907007 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104907007 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104907007 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104907007 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104907022 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104907030 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104907030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104907030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:10.384533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10643): Terminating (SIGTERM) 10:49:10.427099 run iperf3-srv_10.42.42.10(pid=10644): Terminating (SIGTERM) 10:49:10.469478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10645): Terminating (SIGTERM) 10:49:10.512046 run iperf3-srv_10.42.42.10(pid=10646): Terminating (SIGTERM) 10:49:10.554399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10649): Terminating (SIGTERM) 10:49:10.597023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10652): Terminating (SIGTERM) 10:49:10.639459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10655): Terminating (SIGTERM) 10:49:10.682010 --- ParallelTerminationStrategy: PID 10643 died... 10:49:10.702527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10643): Terminated: ok {rc=0} 10:49:10.749362 --- ParallelTerminationStrategy: PID 10644 died... 10:49:10.769192 run iperf3-srv_10.42.42.10(pid=10644): Terminated {rc=256} 10:49:10.815444 --- ParallelTerminationStrategy: PID 10645 died... 10:49:10.835260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10645): Terminated: ok {rc=0} 10:49:10.881602 --- ParallelTerminationStrategy: PID 10646 died... 10:49:10.901407 run iperf3-srv_10.42.42.10(pid=10646): Terminated {rc=256} 10:49:10.947706 --- ParallelTerminationStrategy: PID 10649 died... 10:49:10.967594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10649): Terminated: ok {rc=0} 10:49:11.014062 --- ParallelTerminationStrategy: PID 10652 died... 10:49:11.034041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10652): Terminated: ok {rc=0} 10:49:11.080775 --- ParallelTerminationStrategy: PID 10655 died... 10:49:11.100781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10655): Terminated: ok {rc=0} 10:49:11.190174 bus /gobi_0: Setting Powered False 10:49:12.290085 bus /gobi_0: Setting Powered False 10:49:13.407509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 10:49:14.557718 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:14.572432 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:49:14.626647 tst iperf3.py: using LAC 33423 10:49:14.747797 tst iperf3.py: using RAC 18 10:49:14.870234 tst iperf3.py: using CellId 33423 10:49:14.991744 tst iperf3.py: using BVCI 33424 10:49:15.103979 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:15.115288 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:15.126381 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:15.137344 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:15.148274 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:15.159266 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:15.170289 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:15.181257 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:15.192398 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:49:15.313620 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:49:15.534584 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:15.845338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10657): Launched 10:49:16.148914 run iperf3-srv_10.42.42.10(pid=10658): Launched 10:49:16.289656 tst iperf3.py:8: start network... 10:49:16.517221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:17.042167 run create_hlr_db(pid=10659): Launched 10:49:17.207350 bus /gobi_6: Setting Powered False 10:49:18.267699 run create_hlr_db(pid=10659): Terminated: ok {rc=0} 10:49:18.711123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10661): Launched 10:49:19.037986 run osmo-hlr_10.42.42.2(pid=10662): Launched 10:49:19.161633 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:19.722005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10664): Launched 10:49:20.046624 run osmo-stp_10.42.42.5(pid=10665): Launched 10:49:20.171455 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:20.732328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10667): Launched 10:49:20.858345 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:21.134297 run patchelf(pid=10668): Launched 10:49:21.314885 run osmo-stp_10.42.42.5(pid=10665): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10665)] 10:49:21.452382 run osmo-stp_10.42.42.5(pid=10665): stdout: | (launched: 2022-12-13_10:49:19.986650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:21.591445 run osmo-stp_10.42.42.5(pid=10665): stderr: | 20221213104920177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104920177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104920178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104920178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104920179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104920179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104920179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:21.730879 run osmo-stp_10.42.42.5(pid=10665): stdout: | (launched: 2022-12-13_10:49:19.986650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:21.864176 run osmo-stp_10.42.42.5(pid=10665): stderr: | 20221213104920177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104920177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104920178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104920178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104920179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104920179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104920179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:22.022397 run patchelf(pid=10668): Terminating (SIGINT) 10:49:22.204908 run patchelf(pid=10668): Terminated: ok {rc=0} 10:49:22.337277 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10665): Process ended prematurely: osmo-stp_10.42.42.5(pid=10665) [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10665)] [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 10:49:22.347581 tst iperf3.py:8: Test FAILED (7.8 sec) 10:49:22.375922 run osmo-hlr_10.42.42.2(pid=10662): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10662)] 10:49:22.426804 run osmo-hlr_10.42.42.2(pid=10662): stdout: | (launched: 2022-12-13_10:49:18.977496) 10:49:22.479180 run osmo-hlr_10.42.42.2(pid=10662): stderr: | 20221213104919176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104919176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104919177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104919177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104919177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104919177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104919189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104919198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104919198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104919198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:22.532187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10657): Terminating (SIGTERM) 10:49:22.574315 run iperf3-srv_10.42.42.10(pid=10658): Terminating (SIGTERM) 10:49:22.616438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10661): Terminating (SIGTERM) 10:49:22.658745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10664): Terminating (SIGTERM) 10:49:22.701149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10667): Terminating (SIGTERM) 10:49:22.743532 --- ParallelTerminationStrategy: PID 10657 died... 10:49:22.763882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10657): Terminated: ok {rc=0} 10:49:22.810931 --- ParallelTerminationStrategy: PID 10658 died... 10:49:22.830753 run iperf3-srv_10.42.42.10(pid=10658): Terminated {rc=256} 10:49:22.876921 --- ParallelTerminationStrategy: PID 10661 died... 10:49:22.897213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10661): Terminated: ok {rc=0} 10:49:22.943639 --- ParallelTerminationStrategy: PID 10664 died... 10:49:22.963657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10664): Terminated: ok {rc=0} 10:49:23.010140 --- ParallelTerminationStrategy: PID 10667 died... 10:49:23.030123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10667): Terminated: ok {rc=0} 10:49:23.119096 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 10:49:24.269349 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:24.281801 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:49:24.338153 tst iperf3m4.py: using LAC 33424 10:49:24.461572 tst iperf3m4.py: using RAC 19 10:49:24.581498 tst iperf3m4.py: using CellId 33424 10:49:24.701273 tst iperf3m4.py: using BVCI 33425 10:49:24.811606 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:24.823012 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:24.834131 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:24.845360 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:24.856274 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:24.867195 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:24.878243 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:24.889197 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:24.900306 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:49:25.023193 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:49:25.147800 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:49:25.266351 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:49:25.388135 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:49:25.608918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:25.937053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10669): Launched 10:49:26.221561 run iperf3-srv_10.42.42.10(pid=10670): Launched 10:49:26.343538 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:49:26.562323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:26.888932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10671): Launched 10:49:27.172231 run iperf3-srv_10.42.42.10(pid=10672): Launched 10:49:27.294981 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:49:27.514709 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:27.842333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10673): Launched 10:49:28.126177 run iperf3-srv_10.42.42.10(pid=10674): Launched 10:49:28.249086 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:49:28.468022 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:28.795983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10675): Launched 10:49:29.079794 run iperf3-srv_10.42.42.10(pid=10676): Launched 10:49:29.202507 tst iperf3m4.py:8: start network... 10:49:29.422447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:29.928246 run create_hlr_db(pid=10677): Launched 10:49:30.053612 bus /gobi_6: Setting Powered False 10:49:31.118634 run create_hlr_db(pid=10677): Terminated: ok {rc=0} 10:49:31.616158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10680): Launched 10:49:31.962168 run osmo-hlr_10.42.42.2(pid=10681): Launched 10:49:32.140402 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:32.728433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10683): Launched 10:49:33.033748 run osmo-stp_10.42.42.5(pid=10684): Launched 10:49:33.148804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:33.672404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10686): Launched 10:49:33.790278 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:34.047208 run patchelf(pid=10687): Launched 10:49:34.217131 run osmo-stp_10.42.42.5(pid=10684): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10684)] 10:49:34.345338 run osmo-stp_10.42.42.5(pid=10684): stdout: | (launched: 2022-12-13_10:49:32.976916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:34.474944 run osmo-stp_10.42.42.5(pid=10684): stderr: | 20221213104933146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104933146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104933146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104933147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104933147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104933147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104933147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:34.604504 run osmo-stp_10.42.42.5(pid=10684): stdout: | (launched: 2022-12-13_10:49:32.976916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:34.728709 run osmo-stp_10.42.42.5(pid=10684): stderr: | 20221213104933146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104933146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104933146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104933147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104933147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104933147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104933147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:34.875772 run patchelf(pid=10687): Terminating (SIGINT) 10:49:35.046711 run patchelf(pid=10687): Terminated: ok {rc=0} 10:49:35.170022 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10684): Process ended prematurely: osmo-stp_10.42.42.5(pid=10684) [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10684)] [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 10:49:35.180101 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:49:35.207845 run osmo-hlr_10.42.42.2(pid=10681): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10681)] 10:49:35.256093 run osmo-hlr_10.42.42.2(pid=10681): stdout: | (launched: 2022-12-13_10:49:31.899280) 10:49:35.306200 run osmo-hlr_10.42.42.2(pid=10681): stderr: | 20221213104932266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104932266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104932266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104932266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104932266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104932266 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104932287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104932295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104932295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104932295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:35.356437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10669): Terminating (SIGTERM) 10:49:35.396295 run iperf3-srv_10.42.42.10(pid=10670): Terminating (SIGTERM) 10:49:35.436261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10671): Terminating (SIGTERM) 10:49:35.476509 run iperf3-srv_10.42.42.10(pid=10672): Terminating (SIGTERM) 10:49:35.516401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10673): Terminating (SIGTERM) 10:49:35.556262 run iperf3-srv_10.42.42.10(pid=10674): Terminating (SIGTERM) 10:49:35.595951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10675): Terminating (SIGTERM) 10:49:35.635706 run iperf3-srv_10.42.42.10(pid=10676): Terminating (SIGTERM) 10:49:35.675499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10680): Terminating (SIGTERM) 10:49:35.715884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10683): Terminating (SIGTERM) 10:49:35.756133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10686): Terminating (SIGTERM) 10:49:35.796014 --- ParallelTerminationStrategy: PID 10669 died... 10:49:35.815576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10669): Terminated: ok {rc=0} 10:49:35.859674 --- ParallelTerminationStrategy: PID 10670 died... 10:49:35.878148 run iperf3-srv_10.42.42.10(pid=10670): Terminated {rc=256} 10:49:35.922096 --- ParallelTerminationStrategy: PID 10671 died... 10:49:35.940920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10671): Terminated: ok {rc=0} 10:49:35.985075 --- ParallelTerminationStrategy: PID 10672 died... 10:49:36.003657 run iperf3-srv_10.42.42.10(pid=10672): Terminated {rc=256} 10:49:36.047392 --- ParallelTerminationStrategy: PID 10673 died... 10:49:36.066283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10673): Terminated: ok {rc=0} 10:49:36.110334 --- ParallelTerminationStrategy: PID 10674 died... 10:49:36.129084 run iperf3-srv_10.42.42.10(pid=10674): Terminated {rc=256} 10:49:36.173041 --- ParallelTerminationStrategy: PID 10675 died... 10:49:36.191778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10675): Terminated: ok {rc=0} 10:49:36.235580 --- ParallelTerminationStrategy: PID 10676 died... 10:49:36.254246 run iperf3-srv_10.42.42.10(pid=10676): Terminated {rc=256} 10:49:36.297891 --- ParallelTerminationStrategy: PID 10680 died... 10:49:36.316469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10680): Terminated: ok {rc=0} 10:49:36.360197 --- ParallelTerminationStrategy: PID 10683 died... 10:49:36.379072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10683): Terminated: ok {rc=0} 10:49:36.422966 --- ParallelTerminationStrategy: PID 10686 died... 10:49:36.442072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10686): Terminated: ok {rc=0} 10:49:36.528290 bus /gobi_4: Setting Powered False 10:49:37.628068 bus /gobi_4: Setting Powered False 10:49:38.745192 bus /gobi_1: Setting Powered False 10:49:39.845489 bus /gobi_1: Setting Powered False 10:49:40.962949 bus /gobi_0: Setting Powered False 10:49:42.063706 bus /gobi_0: Setting Powered False 10:49:43.183019 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 10:49:44.286502 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:44.298425 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:49:44.349410 tst ping.py: using LAC 33425 10:49:44.467711 tst ping.py: using RAC 20 10:49:44.594808 tst ping.py: using CellId 33425 10:49:44.719782 tst ping.py: using BVCI 33426 10:49:44.835895 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:44.847584 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:44.859181 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:44.870671 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:44.882235 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:44.895321 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:44.907993 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:44.920323 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:49:45.040481 tst ping.py:19: start network... 10:49:45.240300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:45.705403 run create_hlr_db(pid=10688): Launched 10:49:45.826838 bus /gobi_6: Setting Powered False 10:49:46.891534 run create_hlr_db(pid=10688): Terminated: ok {rc=0} 10:49:47.363923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10690): Launched 10:49:47.684669 run osmo-hlr_10.42.42.2(pid=10691): Launched 10:49:47.806841 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:48.363485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10693): Launched 10:49:48.686186 run osmo-stp_10.42.42.5(pid=10694): Launched 10:49:48.809456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:49.365267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10696): Launched 10:49:49.487946 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:49.759989 run patchelf(pid=10697): Launched 10:49:49.938784 run osmo-stp_10.42.42.5(pid=10694): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10694)] 10:49:50.074936 run osmo-stp_10.42.42.5(pid=10694): stdout: | (launched: 2022-12-13_10:49:48.626487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:50.213179 run osmo-stp_10.42.42.5(pid=10694): stderr: | 20221213104948816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104948816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104948817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104948817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104948818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104948818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104948818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:50.351137 run osmo-stp_10.42.42.5(pid=10694): stdout: | (launched: 2022-12-13_10:49:48.626487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:50.482831 run osmo-stp_10.42.42.5(pid=10694): stderr: | 20221213104948816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104948816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104948817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104948817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104948818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104948818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104948818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:50.638493 run patchelf(pid=10697): Terminating (SIGINT) 10:49:50.818324 run patchelf(pid=10697): Terminated: ok {rc=0} 10:49:50.948039 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10694): Process ended prematurely: osmo-stp_10.42.42.5(pid=10694) [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10694)] [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 10:49:50.957745 tst ping.py:22: Test FAILED (6.7 sec) 10:49:50.986287 run osmo-hlr_10.42.42.2(pid=10691): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10691)] 10:49:51.037629 run osmo-hlr_10.42.42.2(pid=10691): stdout: | (launched: 2022-12-13_10:49:47.625641) 10:49:51.090035 run osmo-hlr_10.42.42.2(pid=10691): stderr: | 20221213104947820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104947820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104947821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104947821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104947821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104947821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104947832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104947843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104947843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104947843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:51.142973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10690): Terminating (SIGTERM) 10:49:51.185614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10693): Terminating (SIGTERM) 10:49:51.227772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10696): Terminating (SIGTERM) 10:49:51.270285 --- ParallelTerminationStrategy: PID 10690 died... 10:49:51.290721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10690): Terminated: ok {rc=0} 10:49:51.337369 --- ParallelTerminationStrategy: PID 10693 died... 10:49:51.357427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10693): Terminated: ok {rc=0} 10:49:51.404290 --- ParallelTerminationStrategy: PID 10696 died... 10:49:51.424508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10696): Terminated: ok {rc=0} 10:49:51.513894 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 10:49:52.603542 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:52.615932 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:49:52.668483 tst ping_idle_ping.py: using LAC 33426 10:49:52.792360 tst ping_idle_ping.py: using RAC 21 10:49:52.914166 tst ping_idle_ping.py: using CellId 33426 10:49:53.035687 tst ping_idle_ping.py: using BVCI 33427 10:49:53.144044 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:53.155547 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:53.166864 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:53.178150 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:53.189340 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:53.200395 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:53.211776 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:49:53.223056 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:49:53.342027 tst ping_idle_ping.py:24: start network... 10:49:53.543211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:54.009488 run create_hlr_db(pid=10698): Launched 10:49:54.130525 bus /gobi_6: Setting Powered False 10:49:55.190393 run create_hlr_db(pid=10698): Terminated: ok {rc=0} 10:49:55.629985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10700): Launched 10:49:55.951741 run osmo-hlr_10.42.42.2(pid=10701): Launched 10:49:56.074986 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:56.630072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10703): Launched 10:49:56.949473 run osmo-stp_10.42.42.5(pid=10704): Launched 10:49:57.073053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:57.627001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10706): Launched 10:49:57.751160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:58.023239 run patchelf(pid=10707): Launched 10:49:58.202821 run osmo-stp_10.42.42.5(pid=10704): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10704)] 10:49:58.338818 run osmo-stp_10.42.42.5(pid=10704): stdout: | (launched: 2022-12-13_10:49:56.890200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:58.476360 run osmo-stp_10.42.42.5(pid=10704): stderr: | 20221213104957081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104957082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104957082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104957082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104957083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104957083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104957083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:58.613811 run osmo-stp_10.42.42.5(pid=10704): stdout: | (launched: 2022-12-13_10:49:56.890200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:58.745319 run osmo-stp_10.42.42.5(pid=10704): stderr: | 20221213104957081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213104957082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213104957082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213104957082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213104957083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213104957083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213104957083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:58.901317 run patchelf(pid=10707): Terminating (SIGINT) 10:49:59.081384 run patchelf(pid=10707): Terminated: ok {rc=0} 10:49:59.211879 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10704): Process ended prematurely: osmo-stp_10.42.42.5(pid=10704) [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10704)] [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 10:49:59.221603 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:49:59.249796 run osmo-hlr_10.42.42.2(pid=10701): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10701)] 10:49:59.301203 run osmo-hlr_10.42.42.2(pid=10701): stdout: | (launched: 2022-12-13_10:49:55.892483) 10:49:59.354047 run osmo-hlr_10.42.42.2(pid=10701): stderr: | 20221213104956088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213104956088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213104956088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213104956088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213104956088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213104956088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213104956101 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213104956110 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213104956110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213104956110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:59.406774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10700): Terminating (SIGTERM) 10:49:59.449376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10703): Terminating (SIGTERM) 10:49:59.492097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10706): Terminating (SIGTERM) 10:49:59.534798 --- ParallelTerminationStrategy: PID 10700 died... 10:49:59.555607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10700): Terminated: ok {rc=0} 10:49:59.602567 --- ParallelTerminationStrategy: PID 10703 died... 10:49:59.622622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10703): Terminated: ok {rc=0} 10:49:59.669580 --- ParallelTerminationStrategy: PID 10706 died... 10:49:59.689778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10706): Terminated: ok {rc=0} 10:49:59.778342 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:50:01.124867 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:01.135099 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:50:01.177600 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:50:01.220045 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:50:01.280216 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:50:01.326471 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:50:01.369598 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:50:01.948025 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:50:01.954031 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:01.968724 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:50:02.041761 tst switch_tch_pdch.py: using LAC 33427 10:50:02.198318 tst switch_tch_pdch.py: using RAC 22 10:50:02.351268 tst switch_tch_pdch.py: using CellId 33427 10:50:02.473107 tst switch_tch_pdch.py: using BVCI 33428 10:50:02.581503 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:02.592702 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:02.603775 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:02.614919 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:02.626098 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:02.637114 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:02.648101 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:50:02.659209 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:50:02.772219 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:50:02.893443 tst switch_tch_pdch.py:51: start network... 10:50:03.109367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:03.605799 run create_hlr_db(pid=10714): Launched 10:50:03.727779 bus /gobi_6: Setting Powered False 10:50:04.790395 run create_hlr_db(pid=10714): Terminated: ok {rc=0} 10:50:05.219429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10716): Launched 10:50:05.518897 run osmo-hlr_10.42.42.2(pid=10717): Launched 10:50:05.634929 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:06.152680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10719): Launched 10:50:06.450356 run osmo-stp_10.42.42.5(pid=10720): Launched 10:50:06.563869 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:50:07.078582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10722): Launched 10:50:07.191859 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:50:07.444681 run patchelf(pid=10723): Launched 10:50:07.610450 run osmo-stp_10.42.42.5(pid=10720): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10720)] 10:50:07.736772 run osmo-stp_10.42.42.5(pid=10720): stdout: | (launched: 2022-12-13_10:50:06.394825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:07.864262 run osmo-stp_10.42.42.5(pid=10720): stderr: | 20221213105006563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105006563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105006564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105006564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105006565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105006565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105006565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:07.992201 run osmo-stp_10.42.42.5(pid=10720): stdout: | (launched: 2022-12-13_10:50:06.394825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:08.114418 run osmo-stp_10.42.42.5(pid=10720): stderr: | 20221213105006563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105006563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105006564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105006564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105006565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105006565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105006565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:08.258888 run patchelf(pid=10723): Terminating (SIGINT) 10:50:08.426606 run patchelf(pid=10723): Terminated: ok {rc=0} 10:50:08.547326 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10720): Process ended prematurely: osmo-stp_10.42.42.5(pid=10720) [trial-2388↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10720)] [trial-2388↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:50:08.556300 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 10:50:08.582825 run osmo-hlr_10.42.42.2(pid=10717): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10717)] 10:50:08.630851 run osmo-hlr_10.42.42.2(pid=10717): stdout: | (launched: 2022-12-13_10:50:05.462710) 10:50:08.680714 run osmo-hlr_10.42.42.2(pid=10717): stderr: | 20221213105005638 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105005639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105005639 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105005639 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105005639 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105005639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105005651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105005660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105005660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105005660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:08.731081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10716): Terminating (SIGTERM) 10:50:08.771154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10719): Terminating (SIGTERM) 10:50:08.811323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10722): Terminating (SIGTERM) 10:50:08.851522 --- ParallelTerminationStrategy: PID 10716 died... 10:50:08.870851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10716): Terminated: ok {rc=0} 10:50:08.915398 --- ParallelTerminationStrategy: PID 10719 died... 10:50:08.934354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10719): Terminated: ok {rc=0} 10:50:08.978478 --- ParallelTerminationStrategy: PID 10722 died... 10:50:08.997255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10722): Terminated: ok {rc=0} 10:50:09.081567 bus /gobi_0: Setting Powered False 10:50:10.181517 bus /gobi_0: Setting Powered False 10:50:11.298585 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:50:12.552529 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:12.558924 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:50:12.592242 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:50:12.628502 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:50:12.684032 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:50:12.716236 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:50:12.750191 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:50:13.303155 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:50:13.308457 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:13.319496 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:50:13.387691 tst switch_tch_pdch.py: using LAC 33428 10:50:13.504681 tst switch_tch_pdch.py: using RAC 23 10:50:13.622916 tst switch_tch_pdch.py: using CellId 33428 10:50:13.741393 tst switch_tch_pdch.py: using BVCI 33429 10:50:13.849079 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:13.860034 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:13.870966 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:13.881839 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:13.892675 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:13.903797 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:13.914936 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:50:13.925901 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:50:14.046315 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:50:14.162566 tst switch_tch_pdch.py:51: start network... 10:50:14.361359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:14.798693 run create_hlr_db(pid=10728): Launched 10:50:14.920179 bus /gobi_6: Setting Powered False 10:50:15.979260 run create_hlr_db(pid=10728): Terminated: ok {rc=0} 10:50:16.491178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10730): Launched 10:50:16.829608 run osmo-hlr_10.42.42.2(pid=10731): Launched 10:50:17.099126 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:17.676763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10733): Launched 10:50:17.998330 run osmo-stp_10.42.42.5(pid=10734): Launched 10:50:18.121692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:50:18.645626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10736): Launched 10:50:18.768738 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:50:19.038220 run patchelf(pid=10737): Launched 10:50:19.217211 run osmo-stp_10.42.42.5(pid=10734): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10734)] 10:50:19.352695 run osmo-stp_10.42.42.5(pid=10734): stdout: | (launched: 2022-12-13_10:50:17.939183) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:19.489373 run osmo-stp_10.42.42.5(pid=10734): stderr: | 20221213105018127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105018127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105018128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105018128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105018129 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105018129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105018129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:19.626514 run osmo-stp_10.42.42.5(pid=10734): stdout: | (launched: 2022-12-13_10:50:17.939183) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:19.757096 run osmo-stp_10.42.42.5(pid=10734): stderr: | 20221213105018127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105018127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105018128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105018128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105018129 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105018129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105018129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:19.912074 run patchelf(pid=10737): Terminating (SIGINT) 10:50:20.091337 run patchelf(pid=10737): Terminated: ok {rc=0} 10:50:20.221099 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10734): Process ended prematurely: osmo-stp_10.42.42.5(pid=10734) [trial-2388↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10734)] [trial-2388↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:50:20.230845 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 10:50:20.258915 run osmo-hlr_10.42.42.2(pid=10731): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10731)] 10:50:20.310010 run osmo-hlr_10.42.42.2(pid=10731): stdout: | (launched: 2022-12-13_10:50:16.770631) 10:50:20.362570 run osmo-hlr_10.42.42.2(pid=10731): stderr: | 20221213105017012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105017012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105017012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105017012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105017012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105017012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105017030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105017038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105017038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105017038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:20.415838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10730): Terminating (SIGTERM) 10:50:20.458519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10733): Terminating (SIGTERM) 10:50:20.501131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10736): Terminating (SIGTERM) 10:50:20.543804 --- ParallelTerminationStrategy: PID 10730 died... 10:50:20.564605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10730): Terminated: ok {rc=0} 10:50:20.611885 --- ParallelTerminationStrategy: PID 10733 died... 10:50:20.631920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10733): Terminated: ok {rc=0} 10:50:20.678814 --- ParallelTerminationStrategy: PID 10736 died... 10:50:20.698958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10736): Terminated: ok {rc=0} 10:50:20.787059 bus /gobi_0: Setting Powered False 10:50:21.889785 bus /gobi_0: Setting Powered False 10:50:23.006704 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_sms:trx-lms --------------------------------------------------------------------- 10:50:24.258220 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:24.262669 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 10:50:24.294937 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 10:50:24.301626 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 10:50:24.352272 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 10:50:24.385056 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 10:50:24.392175 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 10:50:24.929144 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 10:50:24.934306 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 10:50:24.945154 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 10:50:24.993518 tst mo_mt_sms.py: using LAC 33429 10:50:25.121143 tst mo_mt_sms.py: using RAC 24 10:50:25.238597 tst mo_mt_sms.py: using CellId 33429 10:50:25.356896 tst mo_mt_sms.py: using BVCI 33430 10:50:25.464492 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 10:50:25.584545 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 10:50:25.703186 tst mo_mt_sms.py:9: start nitb and bts... 10:50:25.918940 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:50:26.568416 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10742): Launched 10:50:26.887170 run osmo-nitb_10.42.42.2(pid=10743): Launched 10:50:27.064836 run osmo-nitb_10.42.42.2(pid=10743): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10743)] 10:50:27.208227 run osmo-nitb_10.42.42.2(pid=10743): stdout: | (launched: 2022-12-13_10:50:26.828055) 10:50:27.352514 run osmo-nitb_10.42.42.2(pid=10743): stderr: | (launched: 2022-12-13_10:50:26.875511) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:50:27.496743 run osmo-nitb_10.42.42.2(pid=10743): stdout: | (launched: 2022-12-13_10:50:26.828055) 10:50:27.635310 run osmo-nitb_10.42.42.2(pid=10743): stderr: | (launched: 2022-12-13_10:50:26.875511) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10743): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10743) [trial-2388↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10743)] 10:50:28.009543 tst osmo-nitb_10.42.42.2(pid=10743): stdout: | (launched: 2022-12-13_10:50:26.828055) 10:50:28.138353 tst osmo-nitb_10.42.42.2(pid=10743): stderr: | (launched: 2022-12-13_10:50:26.875511) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:50:28.291182 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=10743): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10743) [trial-2388↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10743)] [trial-2388↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 10:50:28.300374 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 10:50:28.307463 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10742): Terminating (SIGTERM) 10:50:28.518603 --- ParallelTerminationStrategy: PID 10742 died... 10:50:28.541405 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10742): Terminated: ok {rc=0} 10:50:28.629762 bus /sierra_3: Setting Powered False 10:50:29.728720 bus /sierra_3: Setting Powered False 10:50:30.844141 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 sms:trx-lms --------------------------------------------------------------------- 10:50:32.049934 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:32.057904 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 10:50:32.095285 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 10:50:32.124907 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 10:50:32.180675 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 10:50:32.216063 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 10:50:32.245284 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 10:50:32.788582 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 10:50:32.794136 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:50:32.805335 tst sms:trx-lms: Using 1 x bts (candidates: 1) 10:50:32.855490 tst mo_mt_sms.py: using LAC 33430 10:50:32.973295 tst mo_mt_sms.py: using RAC 25 10:50:33.090647 tst mo_mt_sms.py: using CellId 33430 10:50:33.213494 tst mo_mt_sms.py: using BVCI 33431 10:50:33.322371 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:50:33.333030 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:50:33.343491 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:50:33.354313 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:50:33.364786 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:50:33.375192 tst sms:trx-lms: Using 1 x modem (candidates: 2) 10:50:33.495097 tst sms:trx-lms: Using 1 x modem (candidates: 2) 10:50:33.614777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:34.079399 run create_hlr_db(pid=10748): Launched 10:50:34.201371 bus /sierra_2: Setting Powered False 10:50:35.264868 run create_hlr_db(pid=10748): Terminated: ok {rc=0} 10:50:35.694013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10750): Launched 10:50:35.992456 run osmo-hlr_10.42.42.2(pid=10751): Launched 10:50:36.117659 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:36.669575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10753): Launched 10:50:36.988068 run osmo-stp_10.42.42.5(pid=10754): Launched 10:50:37.111176 run osmo-msc_10.42.42.6: Starting osmo-msc 10:50:37.690067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10756): Launched 10:50:38.008902 run osmo-msc_10.42.42.6(pid=10757): Launched 10:50:38.189126 run osmo-stp_10.42.42.5(pid=10754): ERR: Terminated: ERROR {rc=1} [trial-2388↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10754)] 10:50:38.324005 run osmo-stp_10.42.42.5(pid=10754): stdout: | (launched: 2022-12-13_10:50:36.929286) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:38.459656 run osmo-stp_10.42.42.5(pid=10754): stderr: | 20221213105037119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105037119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105037119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105037120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105037120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105037120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105037120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:38.593793 run osmo-stp_10.42.42.5(pid=10754): stdout: | (launched: 2022-12-13_10:50:36.929286) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:38.720900 run osmo-stp_10.42.42.5(pid=10754): stderr: | 20221213105037119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105037119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105037119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105037120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105037120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105037120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105037120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:38.873412 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10754): Process ended prematurely: osmo-stp_10.42.42.5(pid=10754) [trial-2388↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10754)] [trial-2388↪sms:trx-lms↪mo_mt_sms.py:16] 10:50:38.882634 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 10:50:38.910056 run osmo-hlr_10.42.42.2(pid=10751): ERR: Terminated: ERROR {rc=237} [trial-2388↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10751)] 10:50:38.961477 run osmo-hlr_10.42.42.2(pid=10751): stdout: | (launched: 2022-12-13_10:50:35.936899) 10:50:39.013986 run osmo-hlr_10.42.42.2(pid=10751): stderr: | 20221213105036125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105036125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105036125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105036125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105036125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105036125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105036138 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105036146 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105036146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105036146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:39.087529 run osmo-msc_10.42.42.6(pid=10757): ERR: Terminated: ERROR {rc=2} [trial-2388↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10757)] 10:50:39.137668 run osmo-msc_10.42.42.6(pid=10757): stdout: | (launched: 2022-12-13_10:50:37.950015) 10:50:39.189912 run osmo-msc_10.42.42.6(pid=10757): stderr: | 20221213105038269 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105038269 DLGLOBAL DEBUG validating counter group 0x7f4fd79f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105038269 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105038269 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105038269 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105038270 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105038271 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105038272 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105038272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105038272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:50:39.243000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10750): Terminating (SIGTERM) 10:50:39.285589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10753): Terminating (SIGTERM) 10:50:39.328189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10756): Terminating (SIGTERM) 10:50:39.370811 --- ParallelTerminationStrategy: PID 10750 died... 10:50:39.391469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10750): Terminated: ok {rc=0} 10:50:39.438408 --- ParallelTerminationStrategy: PID 10753 died... 10:50:39.458482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10753): Terminated: ok {rc=0} 10:50:39.505159 --- ParallelTerminationStrategy: PID 10756 died... 10:50:39.525248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10756): Terminated: ok {rc=0} 10:50:39.614431 bus /sierra_3: Setting Powered False 10:50:40.713386 bus /sierra_3: Setting Powered False 10:50:41.830081 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_ussd:trx-lms --------------------------------------------------------------------- 10:50:43.062849 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:43.067127 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 10:50:43.100498 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 10:50:43.107715 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 10:50:43.144598 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 10:50:43.178948 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 10:50:43.186039 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 10:50:43.704606 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2388 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 10:50:43.710149 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 10:50:43.721444 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 10:50:43.770104 tst assert_extension.py: using LAC 33431 10:50:43.896792 tst assert_extension.py: using RAC 26 10:50:44.021413 tst assert_extension.py: using CellId 33431 10:50:44.140741 tst assert_extension.py: using BVCI 33432 10:50:44.248806 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 10:50:44.366629 tst assert_extension.py:10: start nitb and bts... 10:50:44.582234 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:50:45.235882 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10762): Launched 10:50:45.557187 run osmo-nitb_10.42.42.2(pid=10763): Launched 10:50:45.735365 run osmo-nitb_10.42.42.2(pid=10763): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10763)] 10:50:45.904771 run osmo-nitb_10.42.42.2(pid=10763): stdout: | (launched: 2022-12-13_10:50:45.497965) 10:50:46.059846 run osmo-nitb_10.42.42.2(pid=10763): stderr: | (launched: 2022-12-13_10:50:45.545472) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:50:46.200883 run osmo-nitb_10.42.42.2(pid=10763): stdout: | (launched: 2022-12-13_10:50:45.497965) 10:50:46.334102 run osmo-nitb_10.42.42.2(pid=10763): stderr: | (launched: 2022-12-13_10:50:45.545472) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10763): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10763) [trial-2388↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10763)] 10:50:46.679570 tst osmo-nitb_10.42.42.2(pid=10763): stdout: | (launched: 2022-12-13_10:50:45.497965) 10:50:46.813817 tst osmo-nitb_10.42.42.2(pid=10763): stderr: | (launched: 2022-12-13_10:50:45.545472) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:50:46.971270 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10763): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10763) [trial-2388↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10763)] [trial-2388↪nitb_ussd:trx-lms↪assert_extension.py:12] 10:50:46.981276 tst assert_extension.py:12: Test FAILED (3.3 sec) 10:50:46.989003 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10762): Terminating (SIGTERM) 10:50:47.202795 --- ParallelTerminationStrategy: PID 10762 died... 10:50:47.227420 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10762): Terminated: ok {rc=0} 10:50:47.318386 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 ussd:trx-lms --------------------------------------------------------------------- 10:50:48.494334 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:48.498115 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 10:50:48.530759 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 10:50:48.558394 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 10:50:48.595315 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 10:50:48.629799 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 10:50:48.657153 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 10:50:49.181142 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2388 ussd:trx-lms assert_extension.py ---------------------------------------------- 10:50:49.186766 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:50:49.197724 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 10:50:49.245138 tst assert_extension.py: using LAC 33432 10:50:49.363775 tst assert_extension.py: using RAC 27 10:50:49.488794 tst assert_extension.py: using CellId 33432 10:50:49.613278 tst assert_extension.py: using BVCI 33433 10:50:49.730157 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:50:49.741314 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:50:49.752316 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:50:49.763283 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:50:49.774515 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:50:49.785612 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 10:50:49.902648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:50.365471 run create_hlr_db(pid=10767): Launched 10:50:50.487367 bus /sierra_2: Setting Powered False 10:50:51.547241 run create_hlr_db(pid=10767): Terminated: ok {rc=0} 10:50:51.988624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10771): Launched 10:50:52.312275 run osmo-hlr_10.42.42.2(pid=10772): Launched 10:50:52.435792 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:52.992915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10774): Launched 10:50:53.314324 run osmo-stp_10.42.42.5(pid=10775): Launched 10:50:53.436311 run osmo-msc_10.42.42.6: Starting osmo-msc 10:50:54.015088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10777): Launched 10:50:54.337628 run osmo-msc_10.42.42.6(pid=10778): Launched 10:50:54.517541 run osmo-stp_10.42.42.5(pid=10775): ERR: Terminated: ERROR {rc=1} [trial-2388↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10775)] 10:50:54.653646 run osmo-stp_10.42.42.5(pid=10775): stdout: | (launched: 2022-12-13_10:50:53.254270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:54.789555 run osmo-stp_10.42.42.5(pid=10775): stderr: | 20221213105053443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105053443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105053443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105053444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105053444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105053444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105053444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:54.923410 run osmo-stp_10.42.42.5(pid=10775): stdout: | (launched: 2022-12-13_10:50:53.254270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:55.050781 run osmo-stp_10.42.42.5(pid=10775): stderr: | 20221213105053443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105053443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105053443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105053444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105053444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105053444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105053444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:55.203096 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10775): Process ended prematurely: osmo-stp_10.42.42.5(pid=10775) [trial-2388↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10775)] [trial-2388↪ussd:trx-lms↪assert_extension.py:17] 10:50:55.212544 tst assert_extension.py:17: Test FAILED (6.0 sec) 10:50:55.240075 run osmo-hlr_10.42.42.2(pid=10772): ERR: Terminated: ERROR {rc=237} [trial-2388↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10772)] 10:50:55.291477 run osmo-hlr_10.42.42.2(pid=10772): stdout: | (launched: 2022-12-13_10:50:52.252466) 10:50:55.344356 run osmo-hlr_10.42.42.2(pid=10772): stderr: | 20221213105052447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105052448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105052448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105052448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105052448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105052448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105052461 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105052469 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105052470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105052470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:55.418153 run osmo-msc_10.42.42.6(pid=10778): ERR: Terminated: ERROR {rc=2} [trial-2388↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10778)] 10:50:55.468527 run osmo-msc_10.42.42.6(pid=10778): stdout: | (launched: 2022-12-13_10:50:54.278156) 10:50:55.521158 run osmo-msc_10.42.42.6(pid=10778): stderr: | 20221213105054598 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105054598 DLGLOBAL DEBUG validating counter group 0x7f1e18b9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105054598 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105054598 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105054598 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105054598 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105054600 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105054601 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105054601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105054601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:50:55.574081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10771): Terminating (SIGTERM) 10:50:55.616751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10774): Terminating (SIGTERM) 10:50:55.659532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10777): Terminating (SIGTERM) 10:50:55.702271 --- ParallelTerminationStrategy: PID 10771 died... 10:50:55.722955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10771): Terminated: ok {rc=0} 10:50:55.770064 --- ParallelTerminationStrategy: PID 10774 died... 10:50:55.790215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10774): Terminated: ok {rc=0} 10:50:55.837064 --- ParallelTerminationStrategy: PID 10777 died... 10:50:55.857134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10777): Terminated: ok {rc=0} 10:50:55.946032 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:50:57.159815 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:57.167929 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:50:57.200991 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:50:57.227841 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:50:57.278902 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:50:57.311296 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:50:57.337573 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:50:57.887475 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:50:57.937473 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:50:57.948829 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:50:58.020895 tst mo_mt_call.py: using LAC 33433 10:50:58.139129 tst mo_mt_call.py: using RAC 28 10:50:58.256940 tst mo_mt_call.py: using CellId 33433 10:50:58.374391 tst mo_mt_call.py: using BVCI 33434 10:50:58.485602 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:50:58.496581 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:50:58.507538 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:50:58.518350 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:50:58.529184 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:50:58.540128 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:50:58.659967 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:50:58.776581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:59.247493 run create_hlr_db(pid=10783): Launched 10:50:59.371002 bus /sierra_2: Setting Powered False 10:51:00.431808 run create_hlr_db(pid=10783): Terminated: ok {rc=0} 10:51:00.857687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10785): Launched 10:51:01.236492 run osmo-hlr_10.42.42.2(pid=10786): Launched 10:51:01.486605 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:02.142878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10788): Launched 10:51:02.481969 run osmo-stp_10.42.42.5(pid=10789): Launched 10:51:02.609066 run osmo-msc_10.42.42.6: Starting osmo-msc 10:51:03.195485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10791): Launched 10:51:03.521935 run osmo-msc_10.42.42.6(pid=10792): Launched 10:51:03.703810 run osmo-stp_10.42.42.5(pid=10789): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10789)] 10:51:03.841267 run osmo-stp_10.42.42.5(pid=10789): stdout: | (launched: 2022-12-13_10:51:02.421941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:03.978410 run osmo-stp_10.42.42.5(pid=10789): stderr: | 20221213105102611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105102611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105102611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105102612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105102612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105102612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105102612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:04.114421 run osmo-stp_10.42.42.5(pid=10789): stdout: | (launched: 2022-12-13_10:51:02.421941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:04.243775 run osmo-stp_10.42.42.5(pid=10789): stderr: | 20221213105102611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105102611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105102611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105102612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105102612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105102612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105102612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:04.397844 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10789): Process ended prematurely: osmo-stp_10.42.42.5(pid=10789) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10789)] [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:51:04.407636 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:51:04.435487 run osmo-hlr_10.42.42.2(pid=10786): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10786)] 10:51:04.486252 run osmo-hlr_10.42.42.2(pid=10786): stdout: | (launched: 2022-12-13_10:51:01.159314) 10:51:04.538459 run osmo-hlr_10.42.42.2(pid=10786): stderr: | 20221213105101416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105101416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105101416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105101416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105101416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105101421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105101438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105101451 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105101451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105101451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:04.611987 run osmo-msc_10.42.42.6(pid=10792): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10792)] 10:51:04.662300 run osmo-msc_10.42.42.6(pid=10792): stdout: | (launched: 2022-12-13_10:51:03.461826) 10:51:04.714890 run osmo-msc_10.42.42.6(pid=10792): stderr: | 20221213105103780 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105103781 DLGLOBAL DEBUG validating counter group 0x7f0340987c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105103781 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105103781 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105103781 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105103782 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105103783 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105103784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105103784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105103784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:51:04.767386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10785): Terminating (SIGTERM) 10:51:04.809701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10788): Terminating (SIGTERM) 10:51:04.852053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10791): Terminating (SIGTERM) 10:51:04.894649 --- ParallelTerminationStrategy: PID 10785 died... 10:51:04.915241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10785): Terminated: ok {rc=0} 10:51:04.962189 --- ParallelTerminationStrategy: PID 10788 died... 10:51:04.982373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10788): Terminated: ok {rc=0} 10:51:05.029479 --- ParallelTerminationStrategy: PID 10791 died... 10:51:05.049562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10791): Terminated: ok {rc=0} 10:51:05.139343 bus /sierra_3: Setting Powered False 10:51:06.239946 bus /sierra_3: Setting Powered False 10:51:07.356620 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:51:08.508031 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:08.520130 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:51:08.593726 tst mo_mt_call_osmux.py: using LAC 33434 10:51:08.714098 tst mo_mt_call_osmux.py: using RAC 29 10:51:08.833794 tst mo_mt_call_osmux.py: using CellId 33434 10:51:08.958124 tst mo_mt_call_osmux.py: using BVCI 33435 10:51:09.069299 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:09.080485 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:09.091557 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:09.102730 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:09.113889 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:51:09.124795 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:51:09.239863 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:51:09.365850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:09.871303 run create_hlr_db(pid=10794): Launched 10:51:09.995415 bus /sierra_2: Setting Powered False 10:51:11.059613 run create_hlr_db(pid=10794): Terminated: ok {rc=0} 10:51:11.496091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10796): Launched 10:51:11.802245 run osmo-hlr_10.42.42.2(pid=10797): Launched 10:51:11.919547 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:12.460011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10799): Launched 10:51:12.766286 run osmo-stp_10.42.42.5(pid=10800): Launched 10:51:12.881933 run osmo-msc_10.42.42.6: Starting osmo-msc 10:51:13.431882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10802): Launched 10:51:13.736394 run osmo-msc_10.42.42.6(pid=10803): Launched 10:51:13.906091 run osmo-stp_10.42.42.5(pid=10800): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10800)] 10:51:14.035632 run osmo-stp_10.42.42.5(pid=10800): stdout: | (launched: 2022-12-13_10:51:12.709733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:14.164244 run osmo-stp_10.42.42.5(pid=10800): stderr: | 20221213105112876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105112877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105112877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105112878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105112878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105112878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105112878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:14.290417 run osmo-stp_10.42.42.5(pid=10800): stdout: | (launched: 2022-12-13_10:51:12.709733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:14.411395 run osmo-stp_10.42.42.5(pid=10800): stderr: | 20221213105112876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105112877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105112877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105112878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105112878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105112878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105112878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:14.555559 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10800): Process ended prematurely: osmo-stp_10.42.42.5(pid=10800) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10800)] [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:51:14.564626 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:51:14.591087 run osmo-hlr_10.42.42.2(pid=10797): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10797)] 10:51:14.639114 run osmo-hlr_10.42.42.2(pid=10797): stdout: | (launched: 2022-12-13_10:51:11.745549) 10:51:14.688715 run osmo-hlr_10.42.42.2(pid=10797): stderr: | 20221213105111918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105111918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105111918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105111918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105111918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105111918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105111931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105111939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105111939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105111939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:14.758706 run osmo-msc_10.42.42.6(pid=10803): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10803)] 10:51:14.806773 run osmo-msc_10.42.42.6(pid=10803): stdout: | (launched: 2022-12-13_10:51:13.679689) 10:51:14.856276 run osmo-msc_10.42.42.6(pid=10803): stderr: | 20221213105113946 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105113946 DLGLOBAL DEBUG validating counter group 0x7f91ffd89c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105113946 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105113946 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105113946 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105113946 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105113948 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105113948 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105113949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105113949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:51:14.906344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10796): Terminating (SIGTERM) 10:51:14.946352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10799): Terminating (SIGTERM) 10:51:14.986482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10802): Terminating (SIGTERM) 10:51:15.026515 --- ParallelTerminationStrategy: PID 10796 died... 10:51:15.046221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10796): Terminated: ok {rc=0} 10:51:15.090753 --- ParallelTerminationStrategy: PID 10799 died... 10:51:15.109675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10799): Terminated: ok {rc=0} 10:51:15.153946 --- ParallelTerminationStrategy: PID 10802 died... 10:51:15.172839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10802): Terminated: ok {rc=0} 10:51:15.258716 bus /sierra_3: Setting Powered False 10:51:16.371236 bus /sierra_3: Setting Powered False 10:51:17.502199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:51:18.754315 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:51:18.761626 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:51:18.795692 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:51:18.823883 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:51:18.874608 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:51:18.908189 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:51:18.935475 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:51:19.490926 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:51:19.543754 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:51:19.555404 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:51:19.625853 tst mo_mt_call.py: using LAC 33435 10:51:19.751219 tst mo_mt_call.py: using RAC 30 10:51:19.878002 tst mo_mt_call.py: using CellId 33435 10:51:20.002795 tst mo_mt_call.py: using BVCI 33436 10:51:20.120674 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:51:20.132338 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:51:20.143878 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:51:20.155269 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:51:20.167132 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:51:20.178949 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:51:20.295441 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:51:20.415838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:20.919514 run create_hlr_db(pid=10808): Launched 10:51:21.044041 bus /sierra_2: Setting Powered False 10:51:22.109073 run create_hlr_db(pid=10808): Terminated: ok {rc=0} 10:51:22.545707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10810): Launched 10:51:22.850915 run osmo-hlr_10.42.42.2(pid=10811): Launched 10:51:22.965716 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:23.488797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10813): Launched 10:51:23.793620 run osmo-stp_10.42.42.5(pid=10814): Launched 10:51:23.909092 run osmo-msc_10.42.42.6: Starting osmo-msc 10:51:24.458418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10816): Launched 10:51:24.763131 run osmo-msc_10.42.42.6(pid=10817): Launched 10:51:24.933855 run osmo-stp_10.42.42.5(pid=10814): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10814)] 10:51:25.062597 run osmo-stp_10.42.42.5(pid=10814): stdout: | (launched: 2022-12-13_10:51:23.736879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:25.191128 run osmo-stp_10.42.42.5(pid=10814): stderr: | 20221213105123905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105123905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105123905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105123906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105123906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105123906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105123906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:25.317612 run osmo-stp_10.42.42.5(pid=10814): stdout: | (launched: 2022-12-13_10:51:23.736879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:25.438580 run osmo-stp_10.42.42.5(pid=10814): stderr: | 20221213105123905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105123905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105123905 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105123906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105123906 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105123906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105123906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:25.583370 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10814): Process ended prematurely: osmo-stp_10.42.42.5(pid=10814) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10814)] [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:51:25.592411 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:51:25.618680 run osmo-hlr_10.42.42.2(pid=10811): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10811)] 10:51:25.666454 run osmo-hlr_10.42.42.2(pid=10811): stdout: | (launched: 2022-12-13_10:51:22.793153) 10:51:25.716039 run osmo-hlr_10.42.42.2(pid=10811): stderr: | 20221213105122970 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105122970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105122970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105122970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105122970 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105122970 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105122985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105122996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105122996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105122996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:25.785335 run osmo-msc_10.42.42.6(pid=10817): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10817)] 10:51:25.833353 run osmo-msc_10.42.42.6(pid=10817): stdout: | (launched: 2022-12-13_10:51:24.706240) 10:51:25.882821 run osmo-msc_10.42.42.6(pid=10817): stderr: | 20221213105124973 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105124974 DLGLOBAL DEBUG validating counter group 0x7ff10adf2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105124974 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105124974 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105124974 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105124974 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105124976 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105124976 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105124976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105124976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:51:25.932690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10810): Terminating (SIGTERM) 10:51:25.972591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10813): Terminating (SIGTERM) 10:51:26.012371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10816): Terminating (SIGTERM) 10:51:26.052399 --- ParallelTerminationStrategy: PID 10810 died... 10:51:26.071898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10810): Terminated: ok {rc=0} 10:51:26.116193 --- ParallelTerminationStrategy: PID 10813 died... 10:51:26.135365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10813): Terminated: ok {rc=0} 10:51:26.179573 --- ParallelTerminationStrategy: PID 10816 died... 10:51:26.198460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10816): Terminated: ok {rc=0} 10:51:26.283143 bus /sierra_3: Setting Powered False 10:51:27.382773 bus /sierra_3: Setting Powered False 10:51:28.502134 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:51:29.649205 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:51:29.660846 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:51:29.730279 tst mo_mt_call_osmux.py: using LAC 33436 10:51:29.851686 tst mo_mt_call_osmux.py: using RAC 31 10:51:29.972474 tst mo_mt_call_osmux.py: using CellId 33436 10:51:30.093285 tst mo_mt_call_osmux.py: using BVCI 33437 10:51:30.203247 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:51:30.214296 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:51:30.225165 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:51:30.235983 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:51:30.246866 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:51:30.257721 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:51:30.374295 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:51:30.495746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:31.022938 run create_hlr_db(pid=10819): Launched 10:51:31.188471 bus /sierra_2: Setting Powered False 10:51:32.254416 run create_hlr_db(pid=10819): Terminated: ok {rc=0} 10:51:32.711272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10821): Launched 10:51:33.039424 run osmo-hlr_10.42.42.2(pid=10822): Launched 10:51:33.163716 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:33.728382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10824): Launched 10:51:34.056529 run osmo-stp_10.42.42.5(pid=10825): Launched 10:51:34.181457 run osmo-msc_10.42.42.6: Starting osmo-msc 10:51:34.769990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10827): Launched 10:51:35.096525 run osmo-msc_10.42.42.6(pid=10828): Launched 10:51:35.277367 run osmo-stp_10.42.42.5(pid=10825): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10825)] 10:51:35.414835 run osmo-stp_10.42.42.5(pid=10825): stdout: | (launched: 2022-12-13_10:51:33.996109) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:35.552557 run osmo-stp_10.42.42.5(pid=10825): stderr: | 20221213105134189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105134189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105134189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105134190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105134190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105134190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105134190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:35.688121 run osmo-stp_10.42.42.5(pid=10825): stdout: | (launched: 2022-12-13_10:51:33.996109) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:35.817870 run osmo-stp_10.42.42.5(pid=10825): stderr: | 20221213105134189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105134189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105134189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105134190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105134190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105134190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105134190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:35.972574 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10825): Process ended prematurely: osmo-stp_10.42.42.5(pid=10825) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10825)] [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:51:35.982497 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:51:36.010677 run osmo-hlr_10.42.42.2(pid=10822): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10822)] 10:51:36.062228 run osmo-hlr_10.42.42.2(pid=10822): stdout: | (launched: 2022-12-13_10:51:32.978829) 10:51:36.114903 run osmo-hlr_10.42.42.2(pid=10822): stderr: | 20221213105133176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105133177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105133177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105133177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105133177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105133177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105133189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105133197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105133198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105133198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:36.188147 run osmo-msc_10.42.42.6(pid=10828): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10828)] 10:51:36.239444 run osmo-msc_10.42.42.6(pid=10828): stdout: | (launched: 2022-12-13_10:51:35.036292) 10:51:36.292144 run osmo-msc_10.42.42.6(pid=10828): stderr: | 20221213105135355 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105135355 DLGLOBAL DEBUG validating counter group 0x7f0598832c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105135355 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105135355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105135355 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105135356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105135357 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105135358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105135358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105135358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:51:36.345535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10821): Terminating (SIGTERM) 10:51:36.387659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10824): Terminating (SIGTERM) 10:51:36.430115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10827): Terminating (SIGTERM) 10:51:36.473028 --- ParallelTerminationStrategy: PID 10821 died... 10:51:36.493799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10821): Terminated: ok {rc=0} 10:51:36.541461 --- ParallelTerminationStrategy: PID 10824 died... 10:51:36.561562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10824): Terminated: ok {rc=0} 10:51:36.608172 --- ParallelTerminationStrategy: PID 10827 died... 10:51:36.628185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10827): Terminated: ok {rc=0} 10:51:36.716322 bus /sierra_3: Setting Powered False 10:51:37.816322 bus /sierra_3: Setting Powered False 10:51:38.931462 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:51:40.178608 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:51:40.185444 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:51:40.218288 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:51:40.245272 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:51:40.298192 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:51:40.332014 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:51:40.358235 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:51:40.905982 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:51:40.960262 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:51:40.972318 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:51:41.043288 tst mo_mt_call.py: using LAC 33437 10:51:41.171484 tst mo_mt_call.py: using RAC 32 10:51:41.298867 tst mo_mt_call.py: using CellId 33437 10:51:41.425358 tst mo_mt_call.py: using BVCI 33438 10:51:41.543523 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:51:41.555274 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:51:41.566770 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:51:41.578212 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:51:41.590206 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:51:41.602071 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:51:41.719524 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:51:41.843349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:42.351524 run create_hlr_db(pid=10833): Launched 10:51:42.475700 bus /sierra_2: Setting Powered False 10:51:43.540271 run create_hlr_db(pid=10833): Terminated: ok {rc=0} 10:51:43.993987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10835): Launched 10:51:44.321951 run osmo-hlr_10.42.42.2(pid=10836): Launched 10:51:44.448552 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:45.012382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10838): Launched 10:51:45.340239 run osmo-stp_10.42.42.5(pid=10839): Launched 10:51:45.465321 run osmo-msc_10.42.42.6: Starting osmo-msc 10:51:46.061635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10841): Launched 10:51:46.410676 run osmo-msc_10.42.42.6(pid=10842): Launched 10:51:46.759131 run osmo-stp_10.42.42.5(pid=10839): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10839)] 10:51:46.980308 run osmo-stp_10.42.42.5(pid=10839): stdout: | (launched: 2022-12-13_10:51:45.279756) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:47.121767 run osmo-stp_10.42.42.5(pid=10839): stderr: | 20221213105145469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105145469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105145469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105145470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105145470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105145470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105145470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:47.262737 run osmo-stp_10.42.42.5(pid=10839): stdout: | (launched: 2022-12-13_10:51:45.279756) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:47.397529 run osmo-stp_10.42.42.5(pid=10839): stderr: | 20221213105145469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105145469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105145469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105145470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105145470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105145470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105145470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:47.556124 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10839): Process ended prematurely: osmo-stp_10.42.42.5(pid=10839) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10839)] [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:51:47.566060 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:51:47.594184 run osmo-hlr_10.42.42.2(pid=10836): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10836)] 10:51:47.646922 run osmo-hlr_10.42.42.2(pid=10836): stdout: | (launched: 2022-12-13_10:51:44.261352) 10:51:47.700201 run osmo-hlr_10.42.42.2(pid=10836): stderr: | 20221213105144458 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105144458 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105144458 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105144458 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105144458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105144459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105144471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105144479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105144480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105144480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:47.773704 run osmo-msc_10.42.42.6(pid=10842): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10842)] 10:51:47.824365 run osmo-msc_10.42.42.6(pid=10842): stdout: | (launched: 2022-12-13_10:51:46.350401) 10:51:47.877586 run osmo-msc_10.42.42.6(pid=10842): stderr: | 20221213105146697 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105146697 DLGLOBAL DEBUG validating counter group 0x7f3748a0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105146697 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105146697 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105146697 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105146697 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105146699 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105146700 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105146700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105146700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:51:47.930528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10835): Terminating (SIGTERM) 10:51:47.973057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10838): Terminating (SIGTERM) 10:51:48.015575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10841): Terminating (SIGTERM) 10:51:48.059031 --- ParallelTerminationStrategy: PID 10835 died... 10:51:48.079936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10835): Terminated: ok {rc=0} 10:51:48.127140 --- ParallelTerminationStrategy: PID 10838 died... 10:51:48.147504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10838): Terminated: ok {rc=0} 10:51:48.194678 --- ParallelTerminationStrategy: PID 10841 died... 10:51:48.215102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10841): Terminated: ok {rc=0} 10:51:48.305834 bus /sierra_3: Setting Powered False 10:51:49.405291 bus /sierra_3: Setting Powered False 10:51:50.522541 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:51:51.674164 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:51:51.686370 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:51:51.758371 tst mo_mt_call_osmux.py: using LAC 33438 10:51:51.888187 tst mo_mt_call_osmux.py: using RAC 33 10:51:52.007234 tst mo_mt_call_osmux.py: using CellId 33438 10:51:52.128569 tst mo_mt_call_osmux.py: using BVCI 33439 10:51:52.239259 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:51:52.250368 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:51:52.261323 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:51:52.272056 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:51:52.282881 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:51:52.293662 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:51:52.414926 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:51:52.532604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:53.006032 run create_hlr_db(pid=10844): Launched 10:51:53.131330 bus /sierra_2: Setting Powered False 10:51:54.192261 run create_hlr_db(pid=10844): Terminated: ok {rc=0} 10:51:54.638623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10846): Launched 10:51:54.965594 run osmo-hlr_10.42.42.2(pid=10847): Launched 10:51:55.090119 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:55.652289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10849): Launched 10:51:55.979134 run osmo-stp_10.42.42.5(pid=10850): Launched 10:51:56.103724 run osmo-msc_10.42.42.6: Starting osmo-msc 10:51:56.692810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10852): Launched 10:51:57.018560 run osmo-msc_10.42.42.6(pid=10853): Launched 10:51:57.200021 run osmo-stp_10.42.42.5(pid=10850): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10850)] 10:51:57.337691 run osmo-stp_10.42.42.5(pid=10850): stdout: | (launched: 2022-12-13_10:51:55.919115) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:57.475066 run osmo-stp_10.42.42.5(pid=10850): stderr: | 20221213105156107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105156107 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105156107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105156108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105156109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105156109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105156109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:57.610999 run osmo-stp_10.42.42.5(pid=10850): stdout: | (launched: 2022-12-13_10:51:55.919115) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:57.740499 run osmo-stp_10.42.42.5(pid=10850): stderr: | 20221213105156107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105156107 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105156107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105156108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105156109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105156109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105156109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:57.895826 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10850): Process ended prematurely: osmo-stp_10.42.42.5(pid=10850) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10850)] [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:51:57.905629 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:51:57.933766 run osmo-hlr_10.42.42.2(pid=10847): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10847)] 10:51:57.985249 run osmo-hlr_10.42.42.2(pid=10847): stdout: | (launched: 2022-12-13_10:51:54.905408) 10:51:58.038047 run osmo-hlr_10.42.42.2(pid=10847): stderr: | 20221213105155101 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105155101 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105155101 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105155101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105155101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105155102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105155114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105155123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105155123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105155123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:58.111567 run osmo-msc_10.42.42.6(pid=10853): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10853)] 10:51:58.162030 run osmo-msc_10.42.42.6(pid=10853): stdout: | (launched: 2022-12-13_10:51:56.958303) 10:51:58.214714 run osmo-msc_10.42.42.6(pid=10853): stderr: | 20221213105157277 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105157277 DLGLOBAL DEBUG validating counter group 0x7f0ad5301c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105157277 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105157278 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105157278 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105157278 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105157280 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105157280 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105157280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105157280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:51:58.268147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10846): Terminating (SIGTERM) 10:51:58.310503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10849): Terminating (SIGTERM) 10:51:58.353135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10852): Terminating (SIGTERM) 10:51:58.396465 --- ParallelTerminationStrategy: PID 10846 died... 10:51:58.417209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10846): Terminated: ok {rc=0} 10:51:58.464047 --- ParallelTerminationStrategy: PID 10849 died... 10:51:58.484191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10849): Terminated: ok {rc=0} 10:51:58.530996 --- ParallelTerminationStrategy: PID 10852 died... 10:51:58.550923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10852): Terminated: ok {rc=0} 10:51:58.640023 bus /sierra_3: Setting Powered False 10:51:59.739414 bus /sierra_3: Setting Powered False 10:52:00.857717 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:52:02.120479 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:52:02.127651 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:52:02.161809 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:52:02.191277 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:52:02.244146 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:52:02.283377 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:52:02.314533 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:52:02.852693 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:52:02.902041 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:52:02.913034 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:52:02.981155 tst mo_mt_call.py: using LAC 33439 10:52:03.099637 tst mo_mt_call.py: using RAC 34 10:52:03.221535 tst mo_mt_call.py: using CellId 33439 10:52:03.340151 tst mo_mt_call.py: using BVCI 33440 10:52:03.449329 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:52:03.460265 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:52:03.471059 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:52:03.481788 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:52:03.492547 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:52:03.503403 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:52:03.625775 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:52:03.742716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:04.215076 run create_hlr_db(pid=10858): Launched 10:52:04.340692 bus /sierra_2: Setting Powered False 10:52:05.401697 run create_hlr_db(pid=10858): Terminated: ok {rc=0} 10:52:05.847893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10860): Launched 10:52:06.174903 run osmo-hlr_10.42.42.2(pid=10861): Launched 10:52:06.300401 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:06.861337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10863): Launched 10:52:07.189262 run osmo-stp_10.42.42.5(pid=10864): Launched 10:52:07.314324 run osmo-msc_10.42.42.6: Starting osmo-msc 10:52:07.901682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10866): Launched 10:52:08.227205 run osmo-msc_10.42.42.6(pid=10867): Launched 10:52:08.410687 run osmo-stp_10.42.42.5(pid=10864): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10864)] 10:52:08.548656 run osmo-stp_10.42.42.5(pid=10864): stdout: | (launched: 2022-12-13_10:52:07.128753) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:08.687516 run osmo-stp_10.42.42.5(pid=10864): stderr: | 20221213105207319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105207319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105207320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105207321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105207321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105207321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105207321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:08.825503 run osmo-stp_10.42.42.5(pid=10864): stdout: | (launched: 2022-12-13_10:52:07.128753) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:08.955882 run osmo-stp_10.42.42.5(pid=10864): stderr: | 20221213105207319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105207319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105207320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105207321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105207321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105207321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105207321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:09.111180 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10864): Process ended prematurely: osmo-stp_10.42.42.5(pid=10864) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10864)] [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:52:09.120657 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:52:09.148664 run osmo-hlr_10.42.42.2(pid=10861): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10861)] 10:52:09.199754 run osmo-hlr_10.42.42.2(pid=10861): stdout: | (launched: 2022-12-13_10:52:06.114880) 10:52:09.252462 run osmo-hlr_10.42.42.2(pid=10861): stderr: | 20221213105206310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105206310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105206310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105206311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105206311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105206311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105206323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105206332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105206332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105206332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:09.325890 run osmo-msc_10.42.42.6(pid=10867): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10867)] 10:52:09.376436 run osmo-msc_10.42.42.6(pid=10867): stdout: | (launched: 2022-12-13_10:52:08.167184) 10:52:09.428864 run osmo-msc_10.42.42.6(pid=10867): stderr: | 20221213105208484 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105208485 DLGLOBAL DEBUG validating counter group 0x7f2ee5a6ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105208485 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105208485 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105208485 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105208485 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105208487 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105208487 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105208487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105208487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:52:09.481787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10860): Terminating (SIGTERM) 10:52:09.524215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10863): Terminating (SIGTERM) 10:52:09.566799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10866): Terminating (SIGTERM) 10:52:09.609536 --- ParallelTerminationStrategy: PID 10860 died... 10:52:09.630224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10860): Terminated: ok {rc=0} 10:52:09.677358 --- ParallelTerminationStrategy: PID 10863 died... 10:52:09.697460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10863): Terminated: ok {rc=0} 10:52:09.744466 --- ParallelTerminationStrategy: PID 10866 died... 10:52:09.764699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10866): Terminated: ok {rc=0} 10:52:09.854287 bus /sierra_3: Setting Powered False 10:52:10.956279 bus /sierra_3: Setting Powered False 10:52:12.075021 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:52:13.223578 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:52:13.235332 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:52:13.305065 tst mo_mt_call_osmux.py: using LAC 33440 10:52:13.424485 tst mo_mt_call_osmux.py: using RAC 35 10:52:13.547443 tst mo_mt_call_osmux.py: using CellId 33440 10:52:13.666295 tst mo_mt_call_osmux.py: using BVCI 33441 10:52:13.776294 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:52:13.787449 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:52:13.798448 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:52:13.809379 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:52:13.820268 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:52:13.831141 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:52:13.946800 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:52:14.063483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:14.537335 run create_hlr_db(pid=10873): Launched 10:52:14.662548 bus /sierra_2: Setting Powered False 10:52:15.723698 run create_hlr_db(pid=10873): Terminated: ok {rc=0} 10:52:16.185779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10875): Launched 10:52:16.508362 run osmo-hlr_10.42.42.2(pid=10876): Launched 10:52:16.784171 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:17.487670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10878): Launched 10:52:17.817680 run osmo-stp_10.42.42.5(pid=10879): Launched 10:52:17.942861 run osmo-msc_10.42.42.6: Starting osmo-msc 10:52:18.533642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10881): Launched 10:52:18.860785 run osmo-msc_10.42.42.6(pid=10882): Launched 10:52:19.043211 run osmo-stp_10.42.42.5(pid=10879): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10879)] 10:52:19.181934 run osmo-stp_10.42.42.5(pid=10879): stdout: | (launched: 2022-12-13_10:52:17.757489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:19.320571 run osmo-stp_10.42.42.5(pid=10879): stderr: | 20221213105217947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105217947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105217947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105217947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105217948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105217948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105217948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:19.457464 run osmo-stp_10.42.42.5(pid=10879): stdout: | (launched: 2022-12-13_10:52:17.757489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:19.588038 run osmo-stp_10.42.42.5(pid=10879): stderr: | 20221213105217947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105217947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105217947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105217947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105217948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105217948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105217948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:19.744460 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10879): Process ended prematurely: osmo-stp_10.42.42.5(pid=10879) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10879)] [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:52:19.754432 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:52:19.782788 run osmo-hlr_10.42.42.2(pid=10876): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10876)] 10:52:19.834208 run osmo-hlr_10.42.42.2(pid=10876): stdout: | (launched: 2022-12-13_10:52:16.450708) 10:52:19.887105 run osmo-hlr_10.42.42.2(pid=10876): stderr: | 20221213105216839 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105216839 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105216839 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105216839 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105216839 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105216840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105216867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105216891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105216892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105216892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:19.960434 run osmo-msc_10.42.42.6(pid=10882): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10882)] 10:52:20.011059 run osmo-msc_10.42.42.6(pid=10882): stdout: | (launched: 2022-12-13_10:52:18.800399) 10:52:20.063777 run osmo-msc_10.42.42.6(pid=10882): stderr: | 20221213105219121 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105219121 DLGLOBAL DEBUG validating counter group 0x7fd8bdc63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105219122 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105219122 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105219122 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105219122 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105219124 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105219124 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105219124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105219124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:52:20.116818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10875): Terminating (SIGTERM) 10:52:20.159730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10878): Terminating (SIGTERM) 10:52:20.202858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10881): Terminating (SIGTERM) 10:52:20.246105 --- ParallelTerminationStrategy: PID 10875 died... 10:52:20.267217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10875): Terminated: ok {rc=0} 10:52:20.314652 --- ParallelTerminationStrategy: PID 10878 died... 10:52:20.334889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10878): Terminated: ok {rc=0} 10:52:20.382548 --- ParallelTerminationStrategy: PID 10881 died... 10:52:20.402603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10881): Terminated: ok {rc=0} 10:52:20.492061 bus /sierra_3: Setting Powered False 10:52:21.593369 bus /sierra_3: Setting Powered False 10:52:22.711409 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:52:23.966064 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:52:23.972423 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:52:24.004513 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:52:24.030927 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:52:24.084644 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:52:24.117137 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:52:24.143141 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:52:24.690663 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:52:24.739648 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:24.750825 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:52:24.818904 tst mo_mt_call.py: using LAC 33441 10:52:24.937640 tst mo_mt_call.py: using RAC 36 10:52:25.056614 tst mo_mt_call.py: using CellId 33441 10:52:25.177170 tst mo_mt_call.py: using BVCI 33442 10:52:25.287387 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:25.298372 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:25.309160 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:25.319867 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:25.330725 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:25.341615 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:52:25.463569 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:52:25.580676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:26.053723 run create_hlr_db(pid=10887): Launched 10:52:26.176887 bus /sierra_2: Setting Powered False 10:52:27.238054 run create_hlr_db(pid=10887): Terminated: ok {rc=0} 10:52:27.664140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10889): Launched 10:52:27.970322 run osmo-hlr_10.42.42.2(pid=10890): Launched 10:52:28.084724 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:28.606988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10892): Launched 10:52:28.912442 run osmo-stp_10.42.42.5(pid=10893): Launched 10:52:29.027530 run osmo-msc_10.42.42.6: Starting osmo-msc 10:52:29.579230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10895): Launched 10:52:29.885306 run osmo-msc_10.42.42.6(pid=10896): Launched 10:52:30.054266 run osmo-stp_10.42.42.5(pid=10893): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10893)] 10:52:30.182713 run osmo-stp_10.42.42.5(pid=10893): stdout: | (launched: 2022-12-13_10:52:28.855744) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:30.310920 run osmo-stp_10.42.42.5(pid=10893): stderr: | 20221213105229024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105229024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105229024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105229025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105229025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105229026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105229026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:30.437332 run osmo-stp_10.42.42.5(pid=10893): stdout: | (launched: 2022-12-13_10:52:28.855744) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:30.558431 run osmo-stp_10.42.42.5(pid=10893): stderr: | 20221213105229024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105229024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105229024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105229025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105229025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105229026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105229026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:30.703627 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10893): Process ended prematurely: osmo-stp_10.42.42.5(pid=10893) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10893)] [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:52:30.712573 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:52:30.738864 run osmo-hlr_10.42.42.2(pid=10890): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10890)] 10:52:30.786712 run osmo-hlr_10.42.42.2(pid=10890): stdout: | (launched: 2022-12-13_10:52:27.913662) 10:52:30.836512 run osmo-hlr_10.42.42.2(pid=10890): stderr: | 20221213105228088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105228088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105228088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105228088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105228088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105228088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105228100 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105228109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105228109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105228110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:30.934073 run osmo-msc_10.42.42.6(pid=10896): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10896)] 10:52:30.983417 run osmo-msc_10.42.42.6(pid=10896): stdout: | (launched: 2022-12-13_10:52:29.828533) 10:52:31.034968 run osmo-msc_10.42.42.6(pid=10896): stderr: | 20221213105230096 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105230096 DLGLOBAL DEBUG validating counter group 0x7f7539b57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105230096 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105230096 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105230097 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105230097 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105230099 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105230099 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105230099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105230099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:52:31.086663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10889): Terminating (SIGTERM) 10:52:31.127985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10892): Terminating (SIGTERM) 10:52:31.169238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10895): Terminating (SIGTERM) 10:52:31.210751 --- ParallelTerminationStrategy: PID 10889 died... 10:52:31.230216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10889): Terminated: ok {rc=0} 10:52:31.275433 --- ParallelTerminationStrategy: PID 10892 died... 10:52:31.294917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10892): Terminated: ok {rc=0} 10:52:31.340300 --- ParallelTerminationStrategy: PID 10895 died... 10:52:31.359920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10895): Terminated: ok {rc=0} 10:52:31.445435 bus /sierra_3: Setting Powered False 10:52:32.541912 bus /sierra_3: Setting Powered False 10:52:33.654433 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:52:34.805964 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:34.818031 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:52:34.890800 tst mo_mt_call_osmux.py: using LAC 33442 10:52:35.019835 tst mo_mt_call_osmux.py: using RAC 37 10:52:35.146511 tst mo_mt_call_osmux.py: using CellId 33442 10:52:35.274640 tst mo_mt_call_osmux.py: using BVCI 33443 10:52:35.394419 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:35.406022 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:35.417283 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:35.428446 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:35.439791 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:52:35.451375 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:52:35.572337 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:52:35.694298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:36.199638 run create_hlr_db(pid=10898): Launched 10:52:36.326004 bus /sierra_2: Setting Powered False 10:52:37.390162 run create_hlr_db(pid=10898): Terminated: ok {rc=0} 10:52:37.826340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10900): Launched 10:52:38.131271 run osmo-hlr_10.42.42.2(pid=10901): Launched 10:52:38.247010 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:38.769337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10903): Launched 10:52:39.074274 run osmo-stp_10.42.42.5(pid=10904): Launched 10:52:39.189720 run osmo-msc_10.42.42.6: Starting osmo-msc 10:52:39.738429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10906): Launched 10:52:40.043669 run osmo-msc_10.42.42.6(pid=10919): Launched 10:52:40.214612 run osmo-stp_10.42.42.5(pid=10904): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10904)] 10:52:40.342954 run osmo-stp_10.42.42.5(pid=10904): stdout: | (launched: 2022-12-13_10:52:39.017254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:40.470824 run osmo-stp_10.42.42.5(pid=10904): stderr: | 20221213105239185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105239185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105239185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105239186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105239186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105239186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105239186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:40.597148 run osmo-stp_10.42.42.5(pid=10904): stdout: | (launched: 2022-12-13_10:52:39.017254) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:40.717896 run osmo-stp_10.42.42.5(pid=10904): stderr: | 20221213105239185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105239185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105239185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105239186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105239186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105239186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105239186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:40.862182 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10904): Process ended prematurely: osmo-stp_10.42.42.5(pid=10904) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10904)] [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:52:40.871154 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:52:40.897449 run osmo-hlr_10.42.42.2(pid=10901): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10901)] 10:52:40.945143 run osmo-hlr_10.42.42.2(pid=10901): stdout: | (launched: 2022-12-13_10:52:38.074546) 10:52:40.994447 run osmo-hlr_10.42.42.2(pid=10901): stderr: | 20221213105238252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105238252 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105238252 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105238252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105238252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105238252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105238265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105238274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105238274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105238274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:41.063259 run osmo-msc_10.42.42.6(pid=10919): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10919)] 10:52:41.111062 run osmo-msc_10.42.42.6(pid=10919): stdout: | (launched: 2022-12-13_10:52:39.987095) 10:52:41.160489 run osmo-msc_10.42.42.6(pid=10919): stderr: | 20221213105240258 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105240258 DLGLOBAL DEBUG validating counter group 0x7fe87026ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105240258 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105240258 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105240258 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105240258 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105240260 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105240260 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105240261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105240261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:52:41.210209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10900): Terminating (SIGTERM) 10:52:41.249652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10903): Terminating (SIGTERM) 10:52:41.289190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10906): Terminating (SIGTERM) 10:52:41.328998 --- ParallelTerminationStrategy: PID 10900 died... 10:52:41.348079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10900): Terminated: ok {rc=0} 10:52:41.392033 --- ParallelTerminationStrategy: PID 10903 died... 10:52:41.410733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10903): Terminated: ok {rc=0} 10:52:41.454195 --- ParallelTerminationStrategy: PID 10906 died... 10:52:41.472681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10906): Terminated: ok {rc=0} 10:52:41.555918 bus /sierra_3: Setting Powered False 10:52:42.652257 bus /sierra_3: Setting Powered False 10:52:43.767607 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:52:45.014748 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:52:45.022383 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:52:45.056433 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:52:45.085043 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:52:45.139847 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:52:45.173315 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:52:45.199481 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:52:45.750808 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:52:45.803515 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:52:45.815088 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:52:45.894341 tst mo_mt_call.py: using LAC 33443 10:52:46.035126 tst mo_mt_call.py: using RAC 38 10:52:46.166339 tst mo_mt_call.py: using CellId 33443 10:52:46.288277 tst mo_mt_call.py: using BVCI 33444 10:52:46.402611 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:52:46.414651 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:52:46.426379 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:52:46.438070 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:52:46.450010 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:52:46.461811 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:52:46.580606 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:52:46.731669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:47.224554 run create_hlr_db(pid=10924): Launched 10:52:47.382611 bus /sierra_2: Setting Powered False 10:52:48.442714 run create_hlr_db(pid=10924): Terminated: ok {rc=0} 10:52:48.869379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10926): Launched 10:52:49.173041 run osmo-hlr_10.42.42.2(pid=10927): Launched 10:52:49.287628 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:49.808305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10929): Launched 10:52:50.113128 run osmo-stp_10.42.42.5(pid=10930): Launched 10:52:50.228061 run osmo-msc_10.42.42.6: Starting osmo-msc 10:52:50.778158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10932): Launched 10:52:51.085290 run osmo-msc_10.42.42.6(pid=10933): Launched 10:52:51.254634 run osmo-stp_10.42.42.5(pid=10930): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10930)] 10:52:51.383204 run osmo-stp_10.42.42.5(pid=10930): stdout: | (launched: 2022-12-13_10:52:50.055952) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:51.511555 run osmo-stp_10.42.42.5(pid=10930): stderr: | 20221213105250227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105250227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105250227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105250227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105250228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105250228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105250228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:51.638232 run osmo-stp_10.42.42.5(pid=10930): stdout: | (launched: 2022-12-13_10:52:50.055952) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:51.759256 run osmo-stp_10.42.42.5(pid=10930): stderr: | 20221213105250227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105250227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105250227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105250227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105250228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105250228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105250228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:51.904177 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10930): Process ended prematurely: osmo-stp_10.42.42.5(pid=10930) [trial-2388↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10930)] [trial-2388↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:52:51.913716 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:52:51.940895 run osmo-hlr_10.42.42.2(pid=10927): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10927)] 10:52:51.989223 run osmo-hlr_10.42.42.2(pid=10927): stdout: | (launched: 2022-12-13_10:52:49.116442) 10:52:52.038999 run osmo-hlr_10.42.42.2(pid=10927): stderr: | 20221213105249292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105249292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105249292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105249292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105249292 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105249292 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105249318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105249328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105249328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105249328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:52.108756 run osmo-msc_10.42.42.6(pid=10933): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10933)] 10:52:52.156872 run osmo-msc_10.42.42.6(pid=10933): stdout: | (launched: 2022-12-13_10:52:51.028281) 10:52:52.206647 run osmo-msc_10.42.42.6(pid=10933): stderr: | 20221213105251298 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105251299 DLGLOBAL DEBUG validating counter group 0x7f61da6adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105251299 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105251299 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105251299 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105251299 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105251301 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105251301 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105251302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105251302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:52:52.256575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10926): Terminating (SIGTERM) 10:52:52.296571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10929): Terminating (SIGTERM) 10:52:52.336676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10932): Terminating (SIGTERM) 10:52:52.376820 --- ParallelTerminationStrategy: PID 10926 died... 10:52:52.396361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10926): Terminated: ok {rc=0} 10:52:52.441013 --- ParallelTerminationStrategy: PID 10929 died... 10:52:52.459903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10929): Terminated: ok {rc=0} 10:52:52.503744 --- ParallelTerminationStrategy: PID 10932 died... 10:52:52.522560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10932): Terminated: ok {rc=0} 10:52:52.608388 bus /sierra_3: Setting Powered False 10:52:53.708811 bus /sierra_3: Setting Powered False 10:52:54.825486 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:52:55.978763 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:52:55.990940 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:52:56.244858 tst mo_mt_call_osmux.py: using LAC 33444 10:52:56.373502 tst mo_mt_call_osmux.py: using RAC 39 10:52:56.502310 tst mo_mt_call_osmux.py: using CellId 33444 10:52:56.627957 tst mo_mt_call_osmux.py: using BVCI 33445 10:52:56.746044 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:52:56.757697 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:52:56.769134 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:52:56.781049 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:52:56.792518 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:52:56.804227 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:52:56.926504 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:52:57.047911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:57.555256 run create_hlr_db(pid=10935): Launched 10:52:57.679524 bus /sierra_2: Setting Powered False 10:52:58.743838 run create_hlr_db(pid=10935): Terminated: ok {rc=0} 10:52:59.180260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10937): Launched 10:52:59.486289 run osmo-hlr_10.42.42.2(pid=10938): Launched 10:52:59.602918 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:00.141188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10940): Launched 10:53:00.445680 run osmo-stp_10.42.42.5(pid=10941): Launched 10:53:00.561608 run osmo-msc_10.42.42.6: Starting osmo-msc 10:53:01.150485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10943): Launched 10:53:01.540816 run osmo-msc_10.42.42.6(pid=10944): Launched 10:53:01.776665 run osmo-stp_10.42.42.5(pid=10941): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10941)] 10:53:02.057257 run osmo-stp_10.42.42.5(pid=10941): stdout: | (launched: 2022-12-13_10:53:00.389040) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:02.351891 run osmo-stp_10.42.42.5(pid=10941): stderr: | 20221213105300558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105300558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105300558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105300558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105300559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105300559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105300559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:02.493647 run osmo-stp_10.42.42.5(pid=10941): stdout: | (launched: 2022-12-13_10:53:00.389040) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:02.625735 run osmo-stp_10.42.42.5(pid=10941): stderr: | 20221213105300558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105300558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105300558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105300558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105300559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105300559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105300559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:02.783337 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10941): Process ended prematurely: osmo-stp_10.42.42.5(pid=10941) [trial-2388↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10941)] [trial-2388↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:53:02.793108 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 10:53:02.821423 run osmo-hlr_10.42.42.2(pid=10938): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10938)] 10:53:02.873995 run osmo-hlr_10.42.42.2(pid=10938): stdout: | (launched: 2022-12-13_10:52:59.429368) 10:53:02.927703 run osmo-hlr_10.42.42.2(pid=10938): stderr: | 20221213105259605 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105259605 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105259605 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105259605 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105259605 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105259605 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105259617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105259625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105259626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105259626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:03.002873 run osmo-msc_10.42.42.6(pid=10944): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10944)] 10:53:03.053538 run osmo-msc_10.42.42.6(pid=10944): stdout: | (launched: 2022-12-13_10:53:01.475960) 10:53:03.106998 run osmo-msc_10.42.42.6(pid=10944): stderr: | 20221213105302028 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105302028 DLGLOBAL DEBUG validating counter group 0x7fd076affc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105302028 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105302029 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105302029 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105302029 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105302031 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105302031 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105302031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105302031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:53:03.160805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10937): Terminating (SIGTERM) 10:53:03.204254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10940): Terminating (SIGTERM) 10:53:03.247576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10943): Terminating (SIGTERM) 10:53:03.291503 --- ParallelTerminationStrategy: PID 10937 died... 10:53:03.312816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10937): Terminated: ok {rc=0} 10:53:03.360567 --- ParallelTerminationStrategy: PID 10940 died... 10:53:03.381424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10940): Terminated: ok {rc=0} 10:53:03.428839 --- ParallelTerminationStrategy: PID 10943 died... 10:53:03.449100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10943): Terminated: ok {rc=0} 10:53:03.537890 bus /sierra_3: Setting Powered False 10:53:04.636787 bus /sierra_3: Setting Powered False 10:53:05.756222 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:53:07.014414 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:07.020691 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:53:07.054194 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:53:07.082244 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:53:07.134983 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:53:07.168891 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:53:07.196269 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:53:07.745232 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:53:07.796750 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:53:07.809290 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:53:07.880906 tst mo_mt_call.py: using LAC 33445 10:53:08.007622 tst mo_mt_call.py: using RAC 40 10:53:08.133387 tst mo_mt_call.py: using CellId 33445 10:53:08.259251 tst mo_mt_call.py: using BVCI 33446 10:53:08.377725 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:53:08.388909 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:53:08.400203 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:53:08.411354 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:53:08.422585 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:53:08.434233 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:53:08.549918 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:53:08.664553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:09.130706 run create_hlr_db(pid=10949): Launched 10:53:09.252720 bus /sierra_2: Setting Powered False 10:53:10.313418 run create_hlr_db(pid=10949): Terminated: ok {rc=0} 10:53:10.732933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10951): Launched 10:53:11.034702 run osmo-hlr_10.42.42.2(pid=10952): Launched 10:53:11.148337 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:11.677914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10954): Launched 10:53:11.978081 run osmo-stp_10.42.42.5(pid=10955): Launched 10:53:12.091132 run osmo-msc_10.42.42.6: Starting osmo-msc 10:53:12.632185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10957): Launched 10:53:12.932705 run osmo-msc_10.42.42.6(pid=10958): Launched 10:53:13.100093 run osmo-stp_10.42.42.5(pid=10955): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10955)] 10:53:13.226653 run osmo-stp_10.42.42.5(pid=10955): stdout: | (launched: 2022-12-13_10:53:11.921852) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:13.353187 run osmo-stp_10.42.42.5(pid=10955): stderr: | 20221213105312088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105312088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105312089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105312089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105312090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105312090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105312090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:13.477633 run osmo-stp_10.42.42.5(pid=10955): stdout: | (launched: 2022-12-13_10:53:11.921852) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:13.596652 run osmo-stp_10.42.42.5(pid=10955): stderr: | 20221213105312088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105312088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105312089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105312089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105312090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105312090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105312090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:13.739119 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10955): Process ended prematurely: osmo-stp_10.42.42.5(pid=10955) [trial-2388↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10955)] [trial-2388↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:53:13.748034 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:53:13.774199 run osmo-hlr_10.42.42.2(pid=10952): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10952)] 10:53:13.822057 run osmo-hlr_10.42.42.2(pid=10952): stdout: | (launched: 2022-12-13_10:53:10.978533) 10:53:13.871110 run osmo-hlr_10.42.42.2(pid=10952): stderr: | 20221213105311150 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105311150 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105311150 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105311150 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105311150 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105311150 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105311161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105311169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105311169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105311169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:13.940690 run osmo-msc_10.42.42.6(pid=10958): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10958)] 10:53:13.988099 run osmo-msc_10.42.42.6(pid=10958): stdout: | (launched: 2022-12-13_10:53:12.876180) 10:53:14.037145 run osmo-msc_10.42.42.6(pid=10958): stderr: | 20221213105313145 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105313145 DLGLOBAL DEBUG validating counter group 0x7f1482dafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105313145 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105313145 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105313146 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105313146 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105313147 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105313148 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105313148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105313148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:53:14.086273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10951): Terminating (SIGTERM) 10:53:14.125683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10954): Terminating (SIGTERM) 10:53:14.165157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10957): Terminating (SIGTERM) 10:53:14.204685 --- ParallelTerminationStrategy: PID 10951 died... 10:53:14.223804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10951): Terminated: ok {rc=0} 10:53:14.267159 --- ParallelTerminationStrategy: PID 10954 died... 10:53:14.285486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10954): Terminated: ok {rc=0} 10:53:14.328744 --- ParallelTerminationStrategy: PID 10957 died... 10:53:14.347224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10957): Terminated: ok {rc=0} 10:53:14.429921 bus /sierra_3: Setting Powered False 10:53:15.527325 bus /sierra_3: Setting Powered False 10:53:16.644587 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:53:17.794589 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:53:17.805977 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:53:17.874847 tst mo_mt_call_osmux.py: using LAC 33446 10:53:17.992044 tst mo_mt_call_osmux.py: using RAC 41 10:53:18.118105 tst mo_mt_call_osmux.py: using CellId 33446 10:53:18.242734 tst mo_mt_call_osmux.py: using BVCI 33447 10:53:18.358833 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:53:18.370291 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:53:18.381481 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:53:18.392396 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:53:18.403427 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:53:18.415109 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:53:18.531385 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:53:18.651215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:19.144501 run create_hlr_db(pid=10960): Launched 10:53:19.266209 bus /sierra_2: Setting Powered False 10:53:20.330535 run create_hlr_db(pid=10960): Terminated: ok {rc=0} 10:53:20.776680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10962): Launched 10:53:21.097590 run osmo-hlr_10.42.42.2(pid=10963): Launched 10:53:21.218808 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:21.768474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10965): Launched 10:53:22.088593 run osmo-stp_10.42.42.5(pid=10966): Launched 10:53:22.210289 run osmo-msc_10.42.42.6: Starting osmo-msc 10:53:22.787632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10968): Launched 10:53:23.110335 run osmo-msc_10.42.42.6(pid=10969): Launched 10:53:23.289383 run osmo-stp_10.42.42.5(pid=10966): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10966)] 10:53:23.424781 run osmo-stp_10.42.42.5(pid=10966): stdout: | (launched: 2022-12-13_10:53:22.029765) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:23.560506 run osmo-stp_10.42.42.5(pid=10966): stderr: | 20221213105322219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105322219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105322219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105322219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105322220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105322220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105322220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:23.695112 run osmo-stp_10.42.42.5(pid=10966): stdout: | (launched: 2022-12-13_10:53:22.029765) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:23.823016 run osmo-stp_10.42.42.5(pid=10966): stderr: | 20221213105322219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105322219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105322219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105322219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105322220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105322220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105322220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:23.976074 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10966): Process ended prematurely: osmo-stp_10.42.42.5(pid=10966) [trial-2388↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10966)] [trial-2388↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:53:23.986062 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:53:24.014073 run osmo-hlr_10.42.42.2(pid=10963): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10963)] 10:53:24.065371 run osmo-hlr_10.42.42.2(pid=10963): stdout: | (launched: 2022-12-13_10:53:21.038280) 10:53:24.117609 run osmo-hlr_10.42.42.2(pid=10963): stderr: | 20221213105321233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105321233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105321233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105321233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105321233 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105321233 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105321248 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105321258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105321258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105321258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:24.190971 run osmo-msc_10.42.42.6(pid=10969): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10969)] 10:53:24.240773 run osmo-msc_10.42.42.6(pid=10969): stdout: | (launched: 2022-12-13_10:53:23.051194) 10:53:24.293244 run osmo-msc_10.42.42.6(pid=10969): stderr: | 20221213105323368 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105323368 DLGLOBAL DEBUG validating counter group 0x7f56d0a5ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105323368 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105323368 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105323369 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105323369 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105323370 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105323371 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105323371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105323371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:53:24.345681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10962): Terminating (SIGTERM) 10:53:24.387457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10965): Terminating (SIGTERM) 10:53:24.429099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10968): Terminating (SIGTERM) 10:53:24.471031 --- ParallelTerminationStrategy: PID 10962 died... 10:53:24.491453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10962): Terminated: ok {rc=0} 10:53:24.537971 --- ParallelTerminationStrategy: PID 10965 died... 10:53:24.557961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10965): Terminated: ok {rc=0} 10:53:24.604291 --- ParallelTerminationStrategy: PID 10968 died... 10:53:24.624490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10968): Terminated: ok {rc=0} 10:53:24.713741 bus /sierra_3: Setting Powered False 10:53:25.812512 bus /sierra_3: Setting Powered False 10:53:26.930742 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 emergency:trx-lms --------------------------------------------------------------------- 10:53:28.181216 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:28.186625 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 10:53:28.220867 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 10:53:28.250468 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 10:53:28.337092 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 10:53:28.370716 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 10:53:28.398417 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 10:53:28.981169 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2388 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 10:53:28.986624 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:53:28.997932 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 10:53:29.048831 tst emergency_mo_mt_call.py: using LAC 33447 10:53:29.171565 tst emergency_mo_mt_call.py: using RAC 42 10:53:29.296773 tst emergency_mo_mt_call.py: using CellId 33447 10:53:29.413281 tst emergency_mo_mt_call.py: using BVCI 33448 10:53:29.519224 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:53:29.529920 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:53:29.540201 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:53:29.550596 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:53:29.560875 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:53:29.571235 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:53:29.687643 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:53:29.805196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:30.259346 run create_hlr_db(pid=10974): Launched 10:53:30.378437 bus /sierra_2: Setting Powered False 10:53:31.461571 run create_hlr_db(pid=10974): Terminated: ok {rc=0} 10:53:31.958282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10976): Launched 10:53:32.270919 run osmo-hlr_10.42.42.2(pid=10977): Launched 10:53:32.393844 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:32.945582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10979): Launched 10:53:33.261661 run osmo-stp_10.42.42.5(pid=10980): Launched 10:53:33.393512 tst emergency_mo_mt_call.py: using MSISDN 8115 10:53:33.561933 run osmo-msc_10.42.42.6: Starting osmo-msc 10:53:34.130110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10982): Launched 10:53:34.446507 run osmo-msc_10.42.42.6(pid=10983): Launched 10:53:34.621928 run osmo-stp_10.42.42.5(pid=10980): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10980)] 10:53:34.754974 run osmo-stp_10.42.42.5(pid=10980): stdout: | (launched: 2022-12-13_10:53:33.203100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:34.888505 run osmo-stp_10.42.42.5(pid=10980): stderr: | 20221213105333391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105333392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105333392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105333393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105333393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105333393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105333393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:35.021950 run osmo-stp_10.42.42.5(pid=10980): stdout: | (launched: 2022-12-13_10:53:33.203100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:35.147874 run osmo-stp_10.42.42.5(pid=10980): stderr: | 20221213105333391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105333392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105333392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105333393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105333393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105333393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105333393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:35.299224 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10980): Process ended prematurely: osmo-stp_10.42.42.5(pid=10980) [trial-2388↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10980)] [trial-2388↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 10:53:35.308215 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 10:53:35.335619 run osmo-hlr_10.42.42.2(pid=10977): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10977)] 10:53:35.386539 run osmo-hlr_10.42.42.2(pid=10977): stdout: | (launched: 2022-12-13_10:53:32.209656) 10:53:35.438799 run osmo-hlr_10.42.42.2(pid=10977): stderr: | 20221213105332403 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105332403 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105332403 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105332403 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105332403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105332404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105332418 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105332426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105332426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105332426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:35.511552 run osmo-msc_10.42.42.6(pid=10983): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10983)] 10:53:35.561666 run osmo-msc_10.42.42.6(pid=10983): stdout: | (launched: 2022-12-13_10:53:34.387892) 10:53:35.613657 run osmo-msc_10.42.42.6(pid=10983): stderr: | 20221213105334704 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105334704 DLGLOBAL DEBUG validating counter group 0x7fb66f1d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105334704 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105334704 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105334704 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105334705 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105334706 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105334707 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105334707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105334707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:53:35.666171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10976): Terminating (SIGTERM) 10:53:35.707771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10979): Terminating (SIGTERM) 10:53:35.749840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10982): Terminating (SIGTERM) 10:53:35.792020 --- ParallelTerminationStrategy: PID 10976 died... 10:53:35.812679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10976): Terminated: ok {rc=0} 10:53:35.859828 --- ParallelTerminationStrategy: PID 10979 died... 10:53:35.879969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10979): Terminated: ok {rc=0} 10:53:35.926927 --- ParallelTerminationStrategy: PID 10982 died... 10:53:35.947043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10982): Terminated: ok {rc=0} 10:53:36.036373 bus /sierra_3: Setting Powered False 10:53:37.135010 bus /sierra_3: Setting Powered False 10:53:38.250789 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 10:53:39.336016 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:53:39.347326 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 10:53:39.396901 tst emergency_preemptive_call.py: using LAC 33448 10:53:39.511678 tst emergency_preemptive_call.py: using RAC 43 10:53:39.628387 tst emergency_preemptive_call.py: using CellId 33448 10:53:39.742668 tst emergency_preemptive_call.py: using BVCI 33449 10:53:39.847837 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:53:39.858516 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:53:39.868885 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:53:39.879349 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:53:39.889860 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:53:39.900695 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:53:40.014969 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:53:40.136278 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:53:40.250769 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:53:40.369964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:40.860931 run create_hlr_db(pid=10985): Launched 10:53:40.981333 bus /sierra_2: Setting Powered False 10:53:42.044193 run create_hlr_db(pid=10985): Terminated: ok {rc=0} 10:53:42.465798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10987): Launched 10:53:42.759281 run osmo-hlr_10.42.42.2(pid=10988): Launched 10:53:42.870356 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:43.390131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10990): Launched 10:53:43.684345 run osmo-stp_10.42.42.5(pid=10991): Launched 10:53:43.814619 tst emergency_preemptive_call.py: using MSISDN 8116 10:53:43.965594 run osmo-msc_10.42.42.6: Starting osmo-msc 10:53:44.493231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10993): Launched 10:53:44.788683 run osmo-msc_10.42.42.6(pid=10994): Launched 10:53:44.952603 run osmo-stp_10.42.42.5(pid=10991): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10991)] 10:53:45.076310 run osmo-stp_10.42.42.5(pid=10991): stdout: | (launched: 2022-12-13_10:53:43.628791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:45.200384 run osmo-stp_10.42.42.5(pid=10991): stderr: | 20221213105343796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105343796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105343797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105343797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105343798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105343798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105343798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:45.323623 run osmo-stp_10.42.42.5(pid=10991): stdout: | (launched: 2022-12-13_10:53:43.628791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:45.440716 run osmo-stp_10.42.42.5(pid=10991): stderr: | 20221213105343796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105343796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105343797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105343797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105343798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105343798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105343798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:45.580780 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10991): Process ended prematurely: osmo-stp_10.42.42.5(pid=10991) [trial-2388↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10991)] [trial-2388↪emergency:trx-lms↪emergency_preemptive_call.py:32] 10:53:45.589294 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 10:53:45.615391 run osmo-hlr_10.42.42.2(pid=10988): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10988)] 10:53:45.663219 run osmo-hlr_10.42.42.2(pid=10988): stdout: | (launched: 2022-12-13_10:53:42.704329) 10:53:45.712706 run osmo-hlr_10.42.42.2(pid=10988): stderr: | 20221213105342877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105342877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105342877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105342877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105342877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105342877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105342889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105342898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105342898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105342898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:45.781800 run osmo-msc_10.42.42.6(pid=10994): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10994)] 10:53:45.829553 run osmo-msc_10.42.42.6(pid=10994): stdout: | (launched: 2022-12-13_10:53:44.733160) 10:53:45.887438 run osmo-msc_10.42.42.6(pid=10994): stderr: | 20221213105345002 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105345002 DLGLOBAL DEBUG validating counter group 0x7f217a5a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105345002 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105345002 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105345002 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105345002 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105345004 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105345004 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105345005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105345005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:53:45.957682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10987): Terminating (SIGTERM) 10:53:46.003020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10990): Terminating (SIGTERM) 10:53:46.049676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10993): Terminating (SIGTERM) 10:53:46.096473 --- ParallelTerminationStrategy: PID 10987 died... 10:53:46.118971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10987): Terminated: ok {rc=0} 10:53:46.169229 --- ParallelTerminationStrategy: PID 10990 died... 10:53:46.191013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10990): Terminated: ok {rc=0} 10:53:46.242167 --- ParallelTerminationStrategy: PID 10993 died... 10:53:46.264362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10993): Terminated: ok {rc=0} 10:53:46.357168 bus /sierra_9: Setting Powered False 10:53:47.491396 bus /sierra_9: Setting Powered False 10:53:48.635528 bus /sierra_8: Setting Powered False 10:53:49.738941 bus /sierra_8: Setting Powered False 10:53:50.858494 bus /sierra_3: Setting Powered False 10:53:51.956839 bus /sierra_3: Setting Powered False 10:53:53.074129 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-lms --------------------------------------------------------------------- 10:53:54.361766 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:54.367253 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 10:53:54.402862 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 10:53:54.446750 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 10:53:54.537567 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 10:53:54.572466 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 10:53:54.615479 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 10:53:55.202039 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 10:53:55.259925 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:53:55.271819 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:53:55.324721 tst cs_paging_gprs_active.py: using LAC 33449 10:53:55.456805 tst cs_paging_gprs_active.py: using RAC 44 10:53:55.586153 tst cs_paging_gprs_active.py: using CellId 33449 10:53:55.722731 tst cs_paging_gprs_active.py: using BVCI 33450 10:53:55.844711 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:53:55.857340 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:53:55.869308 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:53:55.881166 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:53:55.894037 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:53:55.907083 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:53:55.920485 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:53:55.933482 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:53:55.946881 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:53:56.076871 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:53:56.200761 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:53:56.426966 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:53:56.760559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11274): Launched 10:53:57.066345 run iperf3-srv_10.42.42.10(pid=11275): Launched 10:53:57.207039 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:53:57.435332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:53:57.774200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11276): Launched 10:53:58.077208 run iperf3-srv_10.42.42.10(pid=11277): Launched 10:53:58.216756 tst cs_paging_gprs_active.py:38: start network... 10:53:58.447447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:58.965744 run create_hlr_db(pid=11278): Launched 10:53:59.136238 bus /sierra_2: Setting Powered False 10:54:00.203002 run create_hlr_db(pid=11278): Terminated: ok {rc=0} 10:54:00.669627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11280): Launched 10:54:01.057505 run osmo-hlr_10.42.42.2(pid=11281): Launched 10:54:01.323971 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:02.062897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11283): Launched 10:54:02.396691 run osmo-stp_10.42.42.5(pid=11284): Launched 10:54:02.679882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:03.493375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11286): Launched 10:54:03.646091 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:03.932377 run patchelf(pid=11287): Launched 10:54:04.132000 run osmo-stp_10.42.42.5(pid=11284): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11284)] 10:54:04.276579 run osmo-stp_10.42.42.5(pid=11284): stdout: | (launched: 2022-12-13_10:54:02.337511) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:04.423149 run osmo-stp_10.42.42.5(pid=11284): stderr: | 20221213105402636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105402636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105402636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105402636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105402641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105402641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105402641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:04.567790 run osmo-stp_10.42.42.5(pid=11284): stdout: | (launched: 2022-12-13_10:54:02.337511) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:04.707923 run osmo-stp_10.42.42.5(pid=11284): stderr: | 20221213105402636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105402636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105402636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105402636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105402641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105402641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105402641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:04.872395 run patchelf(pid=11287): Terminating (SIGINT) 10:54:05.062895 run patchelf(pid=11287): Terminated: ok {rc=0} 10:54:05.199863 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11284): Process ended prematurely: osmo-stp_10.42.42.5(pid=11284) [trial-2388↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11284)] [trial-2388↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 10:54:05.212722 tst cs_paging_gprs_active.py:38: Test FAILED (10.0 sec) 10:54:05.244435 run osmo-hlr_10.42.42.2(pid=11281): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11281)] 10:54:05.298909 run osmo-hlr_10.42.42.2(pid=11281): stdout: | (launched: 2022-12-13_10:54:00.989874) 10:54:05.354373 run osmo-hlr_10.42.42.2(pid=11281): stderr: | 20221213105401330 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105401330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105401331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105401331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105401331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105401331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105401346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105401358 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105401358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105401359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:05.412141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11274): Terminating (SIGTERM) 10:54:05.456381 run iperf3-srv_10.42.42.10(pid=11275): Terminating (SIGTERM) 10:54:05.505329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11276): Terminating (SIGTERM) 10:54:05.551360 run iperf3-srv_10.42.42.10(pid=11277): Terminating (SIGTERM) 10:54:05.599981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11280): Terminating (SIGTERM) 10:54:05.646062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11283): Terminating (SIGTERM) 10:54:05.693830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11286): Terminating (SIGTERM) 10:54:05.742145 --- ParallelTerminationStrategy: PID 11274 died... 10:54:05.764610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11274): Terminated: ok {rc=0} 10:54:05.816456 --- ParallelTerminationStrategy: PID 11275 died... 10:54:05.839328 run iperf3-srv_10.42.42.10(pid=11275): Terminated {rc=256} 10:54:05.888924 --- ParallelTerminationStrategy: PID 11276 died... 10:54:05.911113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11276): Terminated: ok {rc=0} 10:54:05.960837 --- ParallelTerminationStrategy: PID 11277 died... 10:54:05.983361 run iperf3-srv_10.42.42.10(pid=11277): Terminated {rc=256} 10:54:06.034318 --- ParallelTerminationStrategy: PID 11280 died... 10:54:06.056526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11280): Terminated: ok {rc=0} 10:54:06.106408 --- ParallelTerminationStrategy: PID 11283 died... 10:54:06.128803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11283): Terminated: ok {rc=0} 10:54:06.178368 --- ParallelTerminationStrategy: PID 11286 died... 10:54:06.201080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11286): Terminated: ok {rc=0} 10:54:06.297195 bus /gobi_0: Setting Powered False 10:54:07.404329 bus /gobi_0: Setting Powered False 10:54:08.528727 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms iperf3.py ---------------------------------------------- 10:54:09.680495 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:09.692829 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:54:09.746520 tst iperf3.py: using LAC 33450 10:54:09.874383 tst iperf3.py: using RAC 45 10:54:10.002358 tst iperf3.py: using CellId 33450 10:54:10.128612 tst iperf3.py: using BVCI 33451 10:54:10.246152 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:10.257168 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:10.267928 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:10.278764 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:10.289468 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:10.300503 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:10.312150 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:10.323292 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:10.335021 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:54:10.453285 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:54:10.656675 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:10.961218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11288): Launched 10:54:11.225864 run iperf3-srv_10.42.42.10(pid=11289): Launched 10:54:11.339013 tst iperf3.py:8: start network... 10:54:11.541693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:12.010556 run create_hlr_db(pid=11290): Launched 10:54:12.134597 bus /gobi_6: Setting Powered False 10:54:13.195074 run create_hlr_db(pid=11290): Terminated: ok {rc=0} 10:54:13.617150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11292): Launched 10:54:13.919197 run osmo-hlr_10.42.42.2(pid=11293): Launched 10:54:14.033542 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:14.553964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11295): Launched 10:54:14.856564 run osmo-stp_10.42.42.5(pid=11296): Launched 10:54:14.971247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:15.491044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11298): Launched 10:54:15.605817 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:15.869703 run patchelf(pid=11299): Launched 10:54:16.064735 run osmo-stp_10.42.42.5(pid=11296): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11296)] 10:54:16.195685 run osmo-stp_10.42.42.5(pid=11296): stdout: | (launched: 2022-12-13_10:54:14.800593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:16.327938 run osmo-stp_10.42.42.5(pid=11296): stderr: | 20221213105414972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105414972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105414972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105414973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105414973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105414973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105414973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:16.459984 run osmo-stp_10.42.42.5(pid=11296): stdout: | (launched: 2022-12-13_10:54:14.800593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:16.586920 run osmo-stp_10.42.42.5(pid=11296): stderr: | 20221213105414972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105414972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105414972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105414973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105414973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105414973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105414973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:16.736308 run patchelf(pid=11299): Terminating (SIGINT) 10:54:16.911765 run patchelf(pid=11299): Terminated: ok {rc=0} 10:54:17.080712 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11296): Process ended prematurely: osmo-stp_10.42.42.5(pid=11296) [trial-2388↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11296)] [trial-2388↪gprs:trx-lms↪iperf3.py:8] 10:54:17.091006 tst iperf3.py:8: Test FAILED (7.4 sec) 10:54:17.119229 run osmo-hlr_10.42.42.2(pid=11293): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11293)] 10:54:17.168069 run osmo-hlr_10.42.42.2(pid=11293): stdout: | (launched: 2022-12-13_10:54:13.863795) 10:54:17.218547 run osmo-hlr_10.42.42.2(pid=11293): stderr: | 20221213105414043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105414043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105414043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105414043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105414043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105414043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105414055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105414066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105414066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105414066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:17.268854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11288): Terminating (SIGTERM) 10:54:17.308183 run iperf3-srv_10.42.42.10(pid=11289): Terminating (SIGTERM) 10:54:17.347332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11292): Terminating (SIGTERM) 10:54:17.386706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11295): Terminating (SIGTERM) 10:54:17.425850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11298): Terminating (SIGTERM) 10:54:17.465372 --- ParallelTerminationStrategy: PID 11288 died... 10:54:17.484623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11288): Terminated: ok {rc=0} 10:54:17.528449 --- ParallelTerminationStrategy: PID 11289 died... 10:54:17.546921 run iperf3-srv_10.42.42.10(pid=11289): Terminated {rc=256} 10:54:17.590043 --- ParallelTerminationStrategy: PID 11292 died... 10:54:17.608404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11292): Terminated: ok {rc=0} 10:54:17.651756 --- ParallelTerminationStrategy: PID 11295 died... 10:54:17.670221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11295): Terminated: ok {rc=0} 10:54:17.713497 --- ParallelTerminationStrategy: PID 11298 died... 10:54:17.731944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11298): Terminated: ok {rc=0} 10:54:17.817281 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms iperf3m4.py ---------------------------------------------- 10:54:18.963389 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:18.974967 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:54:19.024222 tst iperf3m4.py: using LAC 33451 10:54:19.145504 tst iperf3m4.py: using RAC 46 10:54:19.274456 tst iperf3m4.py: using CellId 33451 10:54:19.404009 tst iperf3m4.py: using BVCI 33452 10:54:19.523495 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:19.534685 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:19.545512 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:19.556190 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:19.567028 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:19.578217 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:19.589739 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:19.600796 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:19.612045 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:54:19.728645 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:54:19.855465 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:54:19.971606 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:54:20.086239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:54:20.290141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:20.594152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11300): Launched 10:54:20.858551 run iperf3-srv_10.42.42.10(pid=11301): Launched 10:54:20.973413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:54:21.174625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:21.477227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11302): Launched 10:54:21.740865 run iperf3-srv_10.42.42.10(pid=11303): Launched 10:54:21.853096 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:54:22.053929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:22.356657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11304): Launched 10:54:22.619142 run iperf3-srv_10.42.42.10(pid=11305): Launched 10:54:22.731777 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:54:22.933546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:23.236587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11306): Launched 10:54:23.499207 run iperf3-srv_10.42.42.10(pid=11307): Launched 10:54:23.612372 tst iperf3m4.py:8: start network... 10:54:23.813616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:24.281849 run create_hlr_db(pid=11308): Launched 10:54:24.404931 bus /gobi_6: Setting Powered False 10:54:25.465779 run create_hlr_db(pid=11308): Terminated: ok {rc=0} 10:54:25.908318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11310): Launched 10:54:26.232700 run osmo-hlr_10.42.42.2(pid=11311): Launched 10:54:26.358513 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:26.917566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11313): Launched 10:54:27.241637 run osmo-stp_10.42.42.5(pid=11314): Launched 10:54:27.367058 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:27.925809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11316): Launched 10:54:28.049074 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:28.321369 run patchelf(pid=11317): Launched 10:54:28.502870 run osmo-stp_10.42.42.5(pid=11314): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11314)] 10:54:28.640765 run osmo-stp_10.42.42.5(pid=11314): stdout: | (launched: 2022-12-13_10:54:27.182495) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:28.779655 run osmo-stp_10.42.42.5(pid=11314): stderr: | 20221213105427375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105427375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105427375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105427376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105427376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105427376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105427376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:28.919029 run osmo-stp_10.42.42.5(pid=11314): stdout: | (launched: 2022-12-13_10:54:27.182495) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:29.052129 run osmo-stp_10.42.42.5(pid=11314): stderr: | 20221213105427375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105427375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105427375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105427376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105427376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105427376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105427376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:29.209863 run patchelf(pid=11317): Terminating (SIGINT) 10:54:29.391587 run patchelf(pid=11317): Terminated: ok {rc=0} 10:54:29.522692 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11314): Process ended prematurely: osmo-stp_10.42.42.5(pid=11314) [trial-2388↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11314)] [trial-2388↪gprs:trx-lms↪iperf3m4.py:8] 10:54:29.532884 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:54:29.561992 run osmo-hlr_10.42.42.2(pid=11311): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11311)] 10:54:29.613360 run osmo-hlr_10.42.42.2(pid=11311): stdout: | (launched: 2022-12-13_10:54:26.173720) 10:54:29.665874 run osmo-hlr_10.42.42.2(pid=11311): stderr: | 20221213105426372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105426373 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105426373 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105426373 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105426373 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105426373 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105426385 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105426393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105426393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105426394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:29.718724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11300): Terminating (SIGTERM) 10:54:29.760909 run iperf3-srv_10.42.42.10(pid=11301): Terminating (SIGTERM) 10:54:29.803094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11302): Terminating (SIGTERM) 10:54:29.845248 run iperf3-srv_10.42.42.10(pid=11303): Terminating (SIGTERM) 10:54:29.887194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11304): Terminating (SIGTERM) 10:54:29.929438 run iperf3-srv_10.42.42.10(pid=11305): Terminating (SIGTERM) 10:54:29.971477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11306): Terminating (SIGTERM) 10:54:30.013720 run iperf3-srv_10.42.42.10(pid=11307): Terminating (SIGTERM) 10:54:30.055639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11310): Terminating (SIGTERM) 10:54:30.097940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11313): Terminating (SIGTERM) 10:54:30.140044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11316): Terminating (SIGTERM) 10:54:30.182523 --- ParallelTerminationStrategy: PID 11300 died... 10:54:30.202859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11300): Terminated: ok {rc=0} 10:54:30.249295 --- ParallelTerminationStrategy: PID 11301 died... 10:54:30.268918 run iperf3-srv_10.42.42.10(pid=11301): Terminated {rc=256} 10:54:30.315192 --- ParallelTerminationStrategy: PID 11302 died... 10:54:30.335293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11302): Terminated: ok {rc=0} 10:54:30.381702 --- ParallelTerminationStrategy: PID 11303 died... 10:54:30.401513 run iperf3-srv_10.42.42.10(pid=11303): Terminated {rc=256} 10:54:30.447774 --- ParallelTerminationStrategy: PID 11304 died... 10:54:30.467646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11304): Terminated: ok {rc=0} 10:54:30.514037 --- ParallelTerminationStrategy: PID 11305 died... 10:54:30.533883 run iperf3-srv_10.42.42.10(pid=11305): Terminated {rc=256} 10:54:30.580171 --- ParallelTerminationStrategy: PID 11306 died... 10:54:30.600161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11306): Terminated: ok {rc=0} 10:54:30.646880 --- ParallelTerminationStrategy: PID 11307 died... 10:54:30.666859 run iperf3-srv_10.42.42.10(pid=11307): Terminated {rc=256} 10:54:30.713323 --- ParallelTerminationStrategy: PID 11310 died... 10:54:30.733377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11310): Terminated: ok {rc=0} 10:54:30.779774 --- ParallelTerminationStrategy: PID 11313 died... 10:54:30.799795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11313): Terminated: ok {rc=0} 10:54:30.846097 --- ParallelTerminationStrategy: PID 11316 died... 10:54:30.880262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11316): Terminated: ok {rc=0} 10:54:30.986385 bus /gobi_4: Setting Powered False 10:54:32.101841 bus /gobi_4: Setting Powered False 10:54:33.230366 bus /gobi_1: Setting Powered False 10:54:34.329581 bus /gobi_1: Setting Powered False 10:54:35.447478 bus /gobi_0: Setting Powered False 10:54:36.545254 bus /gobi_0: Setting Powered False 10:54:37.660812 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms ping.py ---------------------------------------------- 10:54:38.763504 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:38.774873 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:54:38.824092 tst ping.py: using LAC 33452 10:54:38.940239 tst ping.py: using RAC 47 10:54:39.056357 tst ping.py: using CellId 33452 10:54:39.172040 tst ping.py: using BVCI 33453 10:54:39.279549 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:39.290032 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:39.300323 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:39.310595 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:39.320694 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:39.330915 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:39.341279 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:39.351585 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:54:39.469312 tst ping.py:19: start network... 10:54:39.683321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:40.174654 run create_hlr_db(pid=11318): Launched 10:54:40.296296 bus /gobi_6: Setting Powered False 10:54:41.360081 run create_hlr_db(pid=11318): Terminated: ok {rc=0} 10:54:41.786676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11320): Launched 10:54:42.083262 run osmo-hlr_10.42.42.2(pid=11321): Launched 10:54:42.195624 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:42.710412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11323): Launched 10:54:43.006738 run osmo-stp_10.42.42.5(pid=11324): Launched 10:54:43.118530 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:43.629058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11326): Launched 10:54:43.742959 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:43.993583 run patchelf(pid=11327): Launched 10:54:44.157840 run osmo-stp_10.42.42.5(pid=11324): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11324)] 10:54:44.283093 run osmo-stp_10.42.42.5(pid=11324): stdout: | (launched: 2022-12-13_10:54:42.952047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:44.409872 run osmo-stp_10.42.42.5(pid=11324): stderr: | 20221213105443123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105443123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105443123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105443124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105443124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105443124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105443124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:44.536650 run osmo-stp_10.42.42.5(pid=11324): stdout: | (launched: 2022-12-13_10:54:42.952047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:44.657681 run osmo-stp_10.42.42.5(pid=11324): stderr: | 20221213105443123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105443123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105443123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105443124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105443124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105443124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105443124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:44.801421 run patchelf(pid=11327): Terminating (SIGINT) 10:54:44.968610 run patchelf(pid=11327): Terminated: ok {rc=0} 10:54:45.088911 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11324): Process ended prematurely: osmo-stp_10.42.42.5(pid=11324) [trial-2388↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11324)] [trial-2388↪gprs:trx-lms↪ping.py:22] 10:54:45.097842 tst ping.py:22: Test FAILED (6.3 sec) 10:54:45.124352 run osmo-hlr_10.42.42.2(pid=11321): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11321)] 10:54:45.171647 run osmo-hlr_10.42.42.2(pid=11321): stdout: | (launched: 2022-12-13_10:54:42.028725) 10:54:45.220862 run osmo-hlr_10.42.42.2(pid=11321): stderr: | 20221213105442205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105442205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105442205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105442205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105442205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105442205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105442219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105442229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105442229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105442229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:45.270441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11320): Terminating (SIGTERM) 10:54:45.309943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11323): Terminating (SIGTERM) 10:54:45.349577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11326): Terminating (SIGTERM) 10:54:45.389365 --- ParallelTerminationStrategy: PID 11320 died... 10:54:45.408476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11320): Terminated: ok {rc=0} 10:54:45.452197 --- ParallelTerminationStrategy: PID 11323 died... 10:54:45.470908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11323): Terminated: ok {rc=0} 10:54:45.514580 --- ParallelTerminationStrategy: PID 11326 died... 10:54:45.533209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11326): Terminated: ok {rc=0} 10:54:45.619716 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 10:54:46.704498 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:46.716441 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:54:46.766537 tst ping_idle_ping.py: using LAC 33453 10:54:46.928250 tst ping_idle_ping.py: using RAC 48 10:54:47.053424 tst ping_idle_ping.py: using CellId 33453 10:54:47.177157 tst ping_idle_ping.py: using BVCI 33454 10:54:47.294844 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:47.305460 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:47.315843 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:47.326230 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:47.336524 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:47.347470 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:47.358546 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:54:47.369554 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:54:47.489425 tst ping_idle_ping.py:24: start network... 10:54:47.703964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:48.199830 run create_hlr_db(pid=11328): Launched 10:54:48.321279 bus /gobi_6: Setting Powered False 10:54:49.385574 run create_hlr_db(pid=11328): Terminated: ok {rc=0} 10:54:49.813750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11330): Launched 10:54:50.113592 run osmo-hlr_10.42.42.2(pid=11331): Launched 10:54:50.227416 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:50.738954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11333): Launched 10:54:51.035631 run osmo-stp_10.42.42.5(pid=11334): Launched 10:54:51.148930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:51.661411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11336): Launched 10:54:51.774995 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:52.025053 run patchelf(pid=11337): Launched 10:54:52.189816 run osmo-stp_10.42.42.5(pid=11334): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11334)] 10:54:52.315391 run osmo-stp_10.42.42.5(pid=11334): stdout: | (launched: 2022-12-13_10:54:50.980629) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:52.442546 run osmo-stp_10.42.42.5(pid=11334): stderr: | 20221213105451151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105451151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105451151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105451152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105451152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105451152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105451152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:52.569399 run osmo-stp_10.42.42.5(pid=11334): stdout: | (launched: 2022-12-13_10:54:50.980629) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:52.690954 run osmo-stp_10.42.42.5(pid=11334): stderr: | 20221213105451151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105451151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105451151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105451152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105451152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105451152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105451152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:52.836587 run patchelf(pid=11337): Terminating (SIGINT) 10:54:53.003287 run patchelf(pid=11337): Terminated: ok {rc=0} 10:54:53.124057 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11334): Process ended prematurely: osmo-stp_10.42.42.5(pid=11334) [trial-2388↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11334)] [trial-2388↪gprs:trx-lms↪ping_idle_ping.py:27] 10:54:53.132876 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:54:53.159539 run osmo-hlr_10.42.42.2(pid=11331): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11331)] 10:54:53.207040 run osmo-hlr_10.42.42.2(pid=11331): stdout: | (launched: 2022-12-13_10:54:50.058623) 10:54:53.256817 run osmo-hlr_10.42.42.2(pid=11331): stderr: | 20221213105450237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105450237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105450237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105450237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105450237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105450237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105450249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105450258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105450258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105450258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:53.306698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11330): Terminating (SIGTERM) 10:54:53.346497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11333): Terminating (SIGTERM) 10:54:53.386134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11336): Terminating (SIGTERM) 10:54:53.425982 --- ParallelTerminationStrategy: PID 11330 died... 10:54:53.445142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11330): Terminated: ok {rc=0} 10:54:53.489079 --- ParallelTerminationStrategy: PID 11333 died... 10:54:53.507653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11333): Terminated: ok {rc=0} 10:54:53.551208 --- ParallelTerminationStrategy: PID 11336 died... 10:54:53.569841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11336): Terminated: ok {rc=0} 10:54:53.652552 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 10:54:54.950304 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:54:54.956015 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:54:54.989414 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:54:55.029320 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:54:55.117051 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:54:55.150494 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:54:55.189832 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:54:55.782941 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:54:55.834834 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:55.846653 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:54:55.896792 tst cs_paging_gprs_active.py: using LAC 33454 10:54:56.025074 tst cs_paging_gprs_active.py: using RAC 49 10:54:56.154871 tst cs_paging_gprs_active.py: using CellId 33454 10:54:56.281943 tst cs_paging_gprs_active.py: using BVCI 33455 10:54:56.400796 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:56.412180 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:56.423161 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:56.434223 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:56.445326 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:56.456397 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:56.468005 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:56.479294 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:54:56.490770 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:54:56.608189 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:54:56.727153 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:54:56.947319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:57.274388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11343): Launched 10:54:57.539778 run iperf3-srv_10.42.42.10(pid=11344): Launched 10:54:57.653246 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:54:57.857416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:54:58.162678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11345): Launched 10:54:58.426392 run iperf3-srv_10.42.42.10(pid=11346): Launched 10:54:58.539304 tst cs_paging_gprs_active.py:38: start network... 10:54:58.742422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:59.211429 run create_hlr_db(pid=11347): Launched 10:54:59.334668 bus /gobi_6: Setting Powered False 10:55:00.395923 run create_hlr_db(pid=11347): Terminated: ok {rc=0} 10:55:00.817330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11349): Launched 10:55:01.157672 run osmo-hlr_10.42.42.2(pid=11350): Launched 10:55:01.410000 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:02.010006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11355): Launched 10:55:02.330102 run osmo-stp_10.42.42.5(pid=11356): Launched 10:55:02.559696 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:55:03.082605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11358): Launched 10:55:03.198331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:55:03.455174 run patchelf(pid=11359): Launched 10:55:03.625772 run osmo-stp_10.42.42.5(pid=11356): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11356)] 10:55:03.754060 run osmo-stp_10.42.42.5(pid=11356): stdout: | (launched: 2022-12-13_10:55:02.271126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:03.884901 run osmo-stp_10.42.42.5(pid=11356): stderr: | 20221213105502488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105502488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105502488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105502497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105502498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105502498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105502498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:04.014588 run osmo-stp_10.42.42.5(pid=11356): stdout: | (launched: 2022-12-13_10:55:02.271126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:04.138831 run osmo-stp_10.42.42.5(pid=11356): stderr: | 20221213105502488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105502488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105502488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105502497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105502498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105502498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105502498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:04.285613 run patchelf(pid=11359): Terminating (SIGINT) 10:55:04.457234 run patchelf(pid=11359): Terminated: ok {rc=0} 10:55:04.580812 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11356): Process ended prematurely: osmo-stp_10.42.42.5(pid=11356) [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11356)] [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:55:04.590392 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:55:04.617392 run osmo-hlr_10.42.42.2(pid=11350): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11350)] 10:55:04.666260 run osmo-hlr_10.42.42.2(pid=11350): stdout: | (launched: 2022-12-13_10:55:01.095781) 10:55:04.716112 run osmo-hlr_10.42.42.2(pid=11350): stderr: | 20221213105501366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105501366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105501366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105501366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105501366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105501366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105501391 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105501407 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105501407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105501407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:04.766264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11343): Terminating (SIGTERM) 10:55:04.805855 run iperf3-srv_10.42.42.10(pid=11344): Terminating (SIGTERM) 10:55:04.845367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11345): Terminating (SIGTERM) 10:55:04.885390 run iperf3-srv_10.42.42.10(pid=11346): Terminating (SIGTERM) 10:55:04.924676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11349): Terminating (SIGTERM) 10:55:04.963805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11355): Terminating (SIGTERM) 10:55:05.003138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11358): Terminating (SIGTERM) 10:55:05.042861 --- ParallelTerminationStrategy: PID 11343 died... 10:55:05.061893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11343): Terminated: ok {rc=0} 10:55:05.105790 --- ParallelTerminationStrategy: PID 11344 died... 10:55:05.124108 run iperf3-srv_10.42.42.10(pid=11344): Terminated {rc=256} 10:55:05.167833 --- ParallelTerminationStrategy: PID 11345 died... 10:55:05.186315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11345): Terminated: ok {rc=0} 10:55:05.230122 --- ParallelTerminationStrategy: PID 11346 died... 10:55:05.248459 run iperf3-srv_10.42.42.10(pid=11346): Terminated {rc=256} 10:55:05.292101 --- ParallelTerminationStrategy: PID 11349 died... 10:55:05.310644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11349): Terminated: ok {rc=0} 10:55:05.354300 --- ParallelTerminationStrategy: PID 11355 died... 10:55:05.372822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11355): Terminated: ok {rc=0} 10:55:05.416443 --- ParallelTerminationStrategy: PID 11358 died... 10:55:05.435085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11358): Terminated: ok {rc=0} 10:55:05.519997 bus /gobi_0: Setting Powered False 10:55:06.619045 bus /gobi_0: Setting Powered False 10:55:07.733932 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:55:08.879605 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:08.890983 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:55:08.940595 tst iperf3.py: using LAC 33455 10:55:09.060788 tst iperf3.py: using RAC 50 10:55:09.179117 tst iperf3.py: using CellId 33455 10:55:09.304222 tst iperf3.py: using BVCI 33456 10:55:09.415715 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:09.426548 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:09.437165 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:09.447678 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:09.458181 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:09.468576 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:09.479218 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:09.489664 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:09.500219 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:09.622563 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:55:09.842528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:10.172574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11360): Launched 10:55:10.455388 run iperf3-srv_10.42.42.10(pid=11361): Launched 10:55:10.578334 tst iperf3.py:8: start network... 10:55:10.797622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:11.298771 run create_hlr_db(pid=11362): Launched 10:55:11.423923 bus /gobi_6: Setting Powered False 10:55:12.487281 run create_hlr_db(pid=11362): Terminated: ok {rc=0} 10:55:12.922538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11364): Launched 10:55:13.226403 run osmo-hlr_10.42.42.2(pid=11365): Launched 10:55:13.341185 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:13.862639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11367): Launched 10:55:14.166737 run osmo-stp_10.42.42.5(pid=11368): Launched 10:55:14.281895 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:55:14.802362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11370): Launched 10:55:14.918582 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:55:15.172165 run patchelf(pid=11371): Launched 10:55:15.339412 run osmo-stp_10.42.42.5(pid=11368): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11368)] 10:55:15.466933 run osmo-stp_10.42.42.5(pid=11368): stdout: | (launched: 2022-12-13_10:55:14.111292) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:15.595987 run osmo-stp_10.42.42.5(pid=11368): stderr: | 20221213105514285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105514285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105514285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105514286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105514286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105514286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105514286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:15.725229 run osmo-stp_10.42.42.5(pid=11368): stdout: | (launched: 2022-12-13_10:55:14.111292) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:15.848582 run osmo-stp_10.42.42.5(pid=11368): stderr: | 20221213105514285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105514285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105514285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105514286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105514286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105514286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105514286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:16.010501 run patchelf(pid=11371): Terminating (SIGINT) 10:55:16.184099 run patchelf(pid=11371): Terminated: ok {rc=0} 10:55:16.309195 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11368): Process ended prematurely: osmo-stp_10.42.42.5(pid=11368) [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11368)] [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 10:55:16.319771 tst iperf3.py:8: Test FAILED (7.5 sec) 10:55:16.348111 run osmo-hlr_10.42.42.2(pid=11365): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11365)] 10:55:16.397213 run osmo-hlr_10.42.42.2(pid=11365): stdout: | (launched: 2022-12-13_10:55:13.170501) 10:55:16.448919 run osmo-hlr_10.42.42.2(pid=11365): stderr: | 20221213105513346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105513346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105513346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105513346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105513346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105513346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105513358 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105513368 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105513368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105513368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:16.499551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11360): Terminating (SIGTERM) 10:55:16.540760 run iperf3-srv_10.42.42.10(pid=11361): Terminating (SIGTERM) 10:55:16.584811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11364): Terminating (SIGTERM) 10:55:16.626247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11367): Terminating (SIGTERM) 10:55:16.668409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11370): Terminating (SIGTERM) 10:55:16.711145 --- ParallelTerminationStrategy: PID 11360 died... 10:55:16.730632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11360): Terminated: ok {rc=0} 10:55:16.775352 --- ParallelTerminationStrategy: PID 11361 died... 10:55:16.794519 run iperf3-srv_10.42.42.10(pid=11361): Terminated {rc=256} 10:55:16.839453 --- ParallelTerminationStrategy: PID 11364 died... 10:55:16.858677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11364): Terminated: ok {rc=0} 10:55:16.903234 --- ParallelTerminationStrategy: PID 11367 died... 10:55:16.922418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11367): Terminated: ok {rc=0} 10:55:16.966921 --- ParallelTerminationStrategy: PID 11370 died... 10:55:16.986117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11370): Terminated: ok {rc=0} 10:55:17.070986 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:55:18.214599 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:18.226526 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:55:18.277283 tst iperf3m4.py: using LAC 33456 10:55:18.407004 tst iperf3m4.py: using RAC 51 10:55:18.535480 tst iperf3m4.py: using CellId 33456 10:55:18.662383 tst iperf3m4.py: using BVCI 33457 10:55:18.781627 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:18.793209 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:18.804161 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:18.815196 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:18.826207 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:18.837546 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:18.848855 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:18.860114 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:18.871732 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:18.989178 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:19.110592 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:19.227505 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:19.342849 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:55:19.546674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:19.852210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11372): Launched 10:55:20.117652 run iperf3-srv_10.42.42.10(pid=11373): Launched 10:55:20.231254 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:55:20.432942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:20.736716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11374): Launched 10:55:21.000535 run iperf3-srv_10.42.42.10(pid=11375): Launched 10:55:21.113709 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:55:21.315689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:21.620072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11376): Launched 10:55:21.884139 run iperf3-srv_10.42.42.10(pid=11377): Launched 10:55:21.998084 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:55:22.201495 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:22.506553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11378): Launched 10:55:22.771691 run iperf3-srv_10.42.42.10(pid=11379): Launched 10:55:22.884759 tst iperf3m4.py:8: start network... 10:55:23.087499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:23.557708 run create_hlr_db(pid=11380): Launched 10:55:23.685591 bus /gobi_6: Setting Powered False 10:55:24.748866 run create_hlr_db(pid=11380): Terminated: ok {rc=0} 10:55:25.200890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11382): Launched 10:55:25.525061 run osmo-hlr_10.42.42.2(pid=11383): Launched 10:55:25.650893 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:26.208091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11385): Launched 10:55:26.531761 run osmo-stp_10.42.42.5(pid=11386): Launched 10:55:26.657976 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:55:27.215444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11388): Launched 10:55:27.340449 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:55:27.614964 run patchelf(pid=11389): Launched 10:55:27.795654 run osmo-stp_10.42.42.5(pid=11386): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11386)] 10:55:27.933102 run osmo-stp_10.42.42.5(pid=11386): stdout: | (launched: 2022-12-13_10:55:26.472430) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:28.071992 run osmo-stp_10.42.42.5(pid=11386): stderr: | 20221213105526666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105526666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105526666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105526666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105526667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105526667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105526667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:28.210774 run osmo-stp_10.42.42.5(pid=11386): stdout: | (launched: 2022-12-13_10:55:26.472430) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:28.343481 run osmo-stp_10.42.42.5(pid=11386): stderr: | 20221213105526666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105526666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105526666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105526666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105526667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105526667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105526667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:28.501732 run patchelf(pid=11389): Terminating (SIGINT) 10:55:28.683505 run patchelf(pid=11389): Terminated: ok {rc=0} 10:55:28.814366 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11386): Process ended prematurely: osmo-stp_10.42.42.5(pid=11386) [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11386)] [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 10:55:28.824395 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:55:28.853305 run osmo-hlr_10.42.42.2(pid=11383): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11383)] 10:55:28.903931 run osmo-hlr_10.42.42.2(pid=11383): stdout: | (launched: 2022-12-13_10:55:25.465803) 10:55:28.956283 run osmo-hlr_10.42.42.2(pid=11383): stderr: | 20221213105525665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105525665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105525665 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105525665 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105525665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105525666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105525679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105525687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105525687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105525687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:29.008770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11372): Terminating (SIGTERM) 10:55:29.051175 run iperf3-srv_10.42.42.10(pid=11373): Terminating (SIGTERM) 10:55:29.093580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11374): Terminating (SIGTERM) 10:55:29.136045 run iperf3-srv_10.42.42.10(pid=11375): Terminating (SIGTERM) 10:55:29.178738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11376): Terminating (SIGTERM) 10:55:29.221735 run iperf3-srv_10.42.42.10(pid=11377): Terminating (SIGTERM) 10:55:29.264369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11378): Terminating (SIGTERM) 10:55:29.307294 run iperf3-srv_10.42.42.10(pid=11379): Terminating (SIGTERM) 10:55:29.350284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11382): Terminating (SIGTERM) 10:55:29.392583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11385): Terminating (SIGTERM) 10:55:29.434969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11388): Terminating (SIGTERM) 10:55:29.477279 --- ParallelTerminationStrategy: PID 11372 died... 10:55:29.497316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11372): Terminated: ok {rc=0} 10:55:29.543711 --- ParallelTerminationStrategy: PID 11373 died... 10:55:29.563497 run iperf3-srv_10.42.42.10(pid=11373): Terminated {rc=256} 10:55:29.609444 --- ParallelTerminationStrategy: PID 11374 died... 10:55:29.629676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11374): Terminated: ok {rc=0} 10:55:29.676070 --- ParallelTerminationStrategy: PID 11375 died... 10:55:29.695825 run iperf3-srv_10.42.42.10(pid=11375): Terminated {rc=256} 10:55:29.741880 --- ParallelTerminationStrategy: PID 11376 died... 10:55:29.761755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11376): Terminated: ok {rc=0} 10:55:29.807906 --- ParallelTerminationStrategy: PID 11377 died... 10:55:29.827668 run iperf3-srv_10.42.42.10(pid=11377): Terminated {rc=256} 10:55:29.873743 --- ParallelTerminationStrategy: PID 11378 died... 10:55:29.893545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11378): Terminated: ok {rc=0} 10:55:29.939818 --- ParallelTerminationStrategy: PID 11379 died... 10:55:29.959645 run iperf3-srv_10.42.42.10(pid=11379): Terminated {rc=256} 10:55:30.005790 --- ParallelTerminationStrategy: PID 11382 died... 10:55:30.025623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11382): Terminated: ok {rc=0} 10:55:30.072020 --- ParallelTerminationStrategy: PID 11385 died... 10:55:30.092126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11385): Terminated: ok {rc=0} 10:55:30.138671 --- ParallelTerminationStrategy: PID 11388 died... 10:55:30.158637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11388): Terminated: ok {rc=0} 10:55:30.246825 bus /gobi_4: Setting Powered False 10:55:31.354573 bus /gobi_4: Setting Powered False 10:55:32.476131 bus /gobi_1: Setting Powered False 10:55:33.575679 bus /gobi_1: Setting Powered False 10:55:34.691705 bus /gobi_0: Setting Powered False 10:55:35.791176 bus /gobi_0: Setting Powered False 10:55:36.907795 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 10:55:38.011315 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:38.022820 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:55:38.072841 tst ping.py: using LAC 33457 10:55:38.191404 tst ping.py: using RAC 52 10:55:38.309082 tst ping.py: using CellId 33457 10:55:38.425355 tst ping.py: using BVCI 33458 10:55:38.533023 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:38.543854 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:38.554431 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:38.564910 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:38.575422 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:38.586438 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:38.597680 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:38.608629 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:38.725935 tst ping.py:19: start network... 10:55:38.924218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:39.381682 run create_hlr_db(pid=11390): Launched 10:55:39.503027 bus /gobi_6: Setting Powered False 10:55:40.562647 run create_hlr_db(pid=11390): Terminated: ok {rc=0} 10:55:40.997358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11392): Launched 10:55:41.314500 run osmo-hlr_10.42.42.2(pid=11393): Launched 10:55:41.438070 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:41.989681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11395): Launched 10:55:42.307337 run osmo-stp_10.42.42.5(pid=11396): Launched 10:55:42.431060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:55:42.981720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11398): Launched 10:55:43.105170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:55:43.375806 run patchelf(pid=11399): Launched 10:55:43.553301 run osmo-stp_10.42.42.5(pid=11396): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11396)] 10:55:43.688464 run osmo-stp_10.42.42.5(pid=11396): stdout: | (launched: 2022-12-13_10:55:42.249270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:43.825522 run osmo-stp_10.42.42.5(pid=11396): stderr: | 20221213105542441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105542441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105542441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105542442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105542442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105542442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105542442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:43.962265 run osmo-stp_10.42.42.5(pid=11396): stdout: | (launched: 2022-12-13_10:55:42.249270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:44.093189 run osmo-stp_10.42.42.5(pid=11396): stderr: | 20221213105542441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105542441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105542441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105542442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105542442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105542442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105542442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:44.248285 run patchelf(pid=11399): Terminating (SIGINT) 10:55:44.426974 run patchelf(pid=11399): Terminated: ok {rc=0} 10:55:44.555573 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11396): Process ended prematurely: osmo-stp_10.42.42.5(pid=11396) [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11396)] [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 10:55:44.565296 tst ping.py:22: Test FAILED (6.5 sec) 10:55:44.593486 run osmo-hlr_10.42.42.2(pid=11393): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11393)] 10:55:44.644270 run osmo-hlr_10.42.42.2(pid=11393): stdout: | (launched: 2022-12-13_10:55:41.256398) 10:55:44.696732 run osmo-hlr_10.42.42.2(pid=11393): stderr: | 20221213105541456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105541456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105541456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105541456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105541456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105541457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105541468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105541477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105541477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105541477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:44.749925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11392): Terminating (SIGTERM) 10:55:44.792145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11395): Terminating (SIGTERM) 10:55:44.834509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11398): Terminating (SIGTERM) 10:55:44.877133 --- ParallelTerminationStrategy: PID 11392 died... 10:55:44.897858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11392): Terminated: ok {rc=0} 10:55:44.944704 --- ParallelTerminationStrategy: PID 11395 died... 10:55:44.964728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11395): Terminated: ok {rc=0} 10:55:45.011316 --- ParallelTerminationStrategy: PID 11398 died... 10:55:45.031488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11398): Terminated: ok {rc=0} 10:55:45.119946 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:55:46.206311 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:46.218918 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:55:46.274959 tst ping_idle_ping.py: using LAC 33458 10:55:46.402764 tst ping_idle_ping.py: using RAC 53 10:55:46.561777 tst ping_idle_ping.py: using CellId 33458 10:55:46.716731 tst ping_idle_ping.py: using BVCI 33459 10:55:46.827666 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:46.839445 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:46.850718 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:46.861901 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:46.873275 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:46.884372 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:46.896048 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:55:46.907220 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:55:47.023251 tst ping_idle_ping.py:24: start network... 10:55:47.265982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:47.765876 run create_hlr_db(pid=11400): Launched 10:55:47.890258 bus /gobi_6: Setting Powered False 10:55:48.953465 run create_hlr_db(pid=11400): Terminated: ok {rc=0} 10:55:49.380167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11402): Launched 10:55:49.678330 run osmo-hlr_10.42.42.2(pid=11403): Launched 10:55:49.791948 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:50.318882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11405): Launched 10:55:50.616835 run osmo-stp_10.42.42.5(pid=11406): Launched 10:55:50.732481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:55:51.263395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11408): Launched 10:55:51.376515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:55:51.628511 run patchelf(pid=11409): Launched 10:55:51.794156 run osmo-stp_10.42.42.5(pid=11406): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11406)] 10:55:51.933328 run osmo-stp_10.42.42.5(pid=11406): stdout: | (launched: 2022-12-13_10:55:50.561371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:52.070122 run osmo-stp_10.42.42.5(pid=11406): stderr: | 20221213105550733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105550733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105550733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105550734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105550736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105550736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105550736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:52.207274 run osmo-stp_10.42.42.5(pid=11406): stdout: | (launched: 2022-12-13_10:55:50.561371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:52.338712 run osmo-stp_10.42.42.5(pid=11406): stderr: | 20221213105550733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105550733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105550733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105550734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105550736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105550736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105550736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:52.494516 run patchelf(pid=11409): Terminating (SIGINT) 10:55:52.673961 run patchelf(pid=11409): Terminated: ok {rc=0} 10:55:52.803192 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11406): Process ended prematurely: osmo-stp_10.42.42.5(pid=11406) [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11406)] [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 10:55:52.812759 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:55:52.840851 run osmo-hlr_10.42.42.2(pid=11403): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11403)] 10:55:52.891539 run osmo-hlr_10.42.42.2(pid=11403): stdout: | (launched: 2022-12-13_10:55:49.623402) 10:55:52.943401 run osmo-hlr_10.42.42.2(pid=11403): stderr: | 20221213105549801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105549801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105549801 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105549801 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105549801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105549801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105549814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105549823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105549823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105549823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:52.995794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11402): Terminating (SIGTERM) 10:55:53.037950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11405): Terminating (SIGTERM) 10:55:53.080084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11408): Terminating (SIGTERM) 10:55:53.122861 --- ParallelTerminationStrategy: PID 11402 died... 10:55:53.143323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11402): Terminated: ok {rc=0} 10:55:53.190030 --- ParallelTerminationStrategy: PID 11405 died... 10:55:53.209948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11405): Terminated: ok {rc=0} 10:55:53.256505 --- ParallelTerminationStrategy: PID 11408 died... 10:55:53.276758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11408): Terminated: ok {rc=0} 10:55:53.366438 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:55:54.674080 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:55:54.680682 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:55:54.714289 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:55:54.754321 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:55:54.842433 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:55:54.876222 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:55:54.915655 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:55:55.509697 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:55:55.560298 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:55.571326 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:55:55.640557 tst cs_paging_gprs_active.py: using LAC 33459 10:55:55.761290 tst cs_paging_gprs_active.py: using RAC 54 10:55:55.883715 tst cs_paging_gprs_active.py: using CellId 33459 10:55:56.007757 tst cs_paging_gprs_active.py: using BVCI 33460 10:55:56.119284 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:56.130151 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:56.140923 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:56.151748 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:56.162273 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:56.173236 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:56.184033 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:56.194942 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:55:56.205892 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:55:56.322197 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:55:56.442356 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:55:56.663732 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:56.991235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11415): Launched 10:55:57.274675 run iperf3-srv_10.42.42.10(pid=11416): Launched 10:55:57.398118 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:55:57.617839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:55:57.944020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11417): Launched 10:55:58.226004 run iperf3-srv_10.42.42.10(pid=11418): Launched 10:55:58.349382 tst cs_paging_gprs_active.py:38: start network... 10:55:58.568876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:59.070815 run create_hlr_db(pid=11419): Launched 10:55:59.195871 bus /gobi_6: Setting Powered False 10:56:00.260753 run create_hlr_db(pid=11419): Terminated: ok {rc=0} 10:56:00.693712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11421): Launched 10:56:01.013755 run osmo-hlr_10.42.42.2(pid=11422): Launched 10:56:01.433999 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:02.152232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11424): Launched 10:56:02.492309 run osmo-stp_10.42.42.5(pid=11425): Launched 10:56:02.617580 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:03.179193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11427): Launched 10:56:03.304768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:03.587289 run patchelf(pid=11428): Launched 10:56:03.767723 run osmo-stp_10.42.42.5(pid=11425): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11425)] 10:56:03.905118 run osmo-stp_10.42.42.5(pid=11425): stdout: | (launched: 2022-12-13_10:56:02.432930) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:04.043511 run osmo-stp_10.42.42.5(pid=11425): stderr: | 20221213105602627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105602627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105602627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105602628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105602628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105602628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105602629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:04.181977 run osmo-stp_10.42.42.5(pid=11425): stdout: | (launched: 2022-12-13_10:56:02.432930) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:04.314912 run osmo-stp_10.42.42.5(pid=11425): stderr: | 20221213105602627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105602627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105602627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105602628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105602628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105602628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105602629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:04.473279 run patchelf(pid=11428): Terminating (SIGINT) 10:56:04.655713 run patchelf(pid=11428): Terminated: ok {rc=0} 10:56:04.787439 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11425): Process ended prematurely: osmo-stp_10.42.42.5(pid=11425) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11425)] [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:56:04.797538 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 10:56:04.826062 run osmo-hlr_10.42.42.2(pid=11422): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11422)] 10:56:04.876289 run osmo-hlr_10.42.42.2(pid=11422): stdout: | (launched: 2022-12-13_10:56:00.951824) 10:56:04.927981 run osmo-hlr_10.42.42.2(pid=11422): stderr: | 20221213105601318 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105601318 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105601318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105601318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105601318 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105601318 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105601338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105601356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105601356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105601356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:04.979880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11415): Terminating (SIGTERM) 10:56:05.021846 run iperf3-srv_10.42.42.10(pid=11416): Terminating (SIGTERM) 10:56:05.063656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11417): Terminating (SIGTERM) 10:56:05.105567 run iperf3-srv_10.42.42.10(pid=11418): Terminating (SIGTERM) 10:56:05.147118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11421): Terminating (SIGTERM) 10:56:05.188908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11424): Terminating (SIGTERM) 10:56:05.230673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11427): Terminating (SIGTERM) 10:56:05.272610 --- ParallelTerminationStrategy: PID 11415 died... 10:56:05.293101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11415): Terminated: ok {rc=0} 10:56:05.339320 --- ParallelTerminationStrategy: PID 11416 died... 10:56:05.359090 run iperf3-srv_10.42.42.10(pid=11416): Terminated {rc=256} 10:56:05.405336 --- ParallelTerminationStrategy: PID 11417 died... 10:56:05.425249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11417): Terminated: ok {rc=0} 10:56:05.471419 --- ParallelTerminationStrategy: PID 11418 died... 10:56:05.491215 run iperf3-srv_10.42.42.10(pid=11418): Terminated {rc=256} 10:56:05.537476 --- ParallelTerminationStrategy: PID 11421 died... 10:56:05.557312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11421): Terminated: ok {rc=0} 10:56:05.603392 --- ParallelTerminationStrategy: PID 11424 died... 10:56:05.623191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11424): Terminated: ok {rc=0} 10:56:05.669307 --- ParallelTerminationStrategy: PID 11427 died... 10:56:05.688850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11427): Terminated: ok {rc=0} 10:56:05.776569 bus /gobi_0: Setting Powered False 10:56:06.874774 bus /gobi_0: Setting Powered False 10:56:07.989972 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:56:09.138864 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:09.150892 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:56:09.221635 tst iperf3.py: using LAC 33460 10:56:09.341140 tst iperf3.py: using RAC 55 10:56:09.459847 tst iperf3.py: using CellId 33460 10:56:09.579796 tst iperf3.py: using BVCI 33461 10:56:09.688864 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:09.699787 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:09.710553 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:09.720897 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:09.731464 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:09.741956 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:09.752667 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:09.763149 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:09.773769 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:09.888536 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:56:10.091831 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:10.395505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11429): Launched 10:56:10.661736 run iperf3-srv_10.42.42.10(pid=11430): Launched 10:56:10.774562 tst iperf3.py:8: start network... 10:56:10.976702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:11.443610 run create_hlr_db(pid=11431): Launched 10:56:11.567061 bus /gobi_6: Setting Powered False 10:56:12.627300 run create_hlr_db(pid=11431): Terminated: ok {rc=0} 10:56:13.068306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11433): Launched 10:56:13.392313 run osmo-hlr_10.42.42.2(pid=11434): Launched 10:56:13.515845 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:14.077353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11436): Launched 10:56:14.400901 run osmo-stp_10.42.42.5(pid=11437): Launched 10:56:14.526080 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:15.086858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11439): Launched 10:56:15.212130 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:15.486685 run patchelf(pid=11440): Launched 10:56:15.667633 run osmo-stp_10.42.42.5(pid=11437): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11437)] 10:56:15.804941 run osmo-stp_10.42.42.5(pid=11437): stdout: | (launched: 2022-12-13_10:56:14.341381) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:15.959679 run osmo-stp_10.42.42.5(pid=11437): stderr: | 20221213105614535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105614535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105614536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105614536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105614537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105614537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105614537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:16.102424 run osmo-stp_10.42.42.5(pid=11437): stdout: | (launched: 2022-12-13_10:56:14.341381) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:16.238989 run osmo-stp_10.42.42.5(pid=11437): stderr: | 20221213105614535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105614535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105614536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105614536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105614537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105614537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105614537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:16.401677 run patchelf(pid=11440): Terminating (SIGINT) 10:56:16.587790 run patchelf(pid=11440): Terminated: ok {rc=0} 10:56:16.722813 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11437): Process ended prematurely: osmo-stp_10.42.42.5(pid=11437) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11437)] [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 10:56:16.734280 tst iperf3.py:8: Test FAILED (7.6 sec) 10:56:16.764178 run osmo-hlr_10.42.42.2(pid=11434): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11434)] 10:56:16.818527 run osmo-hlr_10.42.42.2(pid=11434): stdout: | (launched: 2022-12-13_10:56:13.332323) 10:56:16.873092 run osmo-hlr_10.42.42.2(pid=11434): stderr: | 20221213105613532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105613532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105613532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105613532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105613532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105613532 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105613544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105613553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105613553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105613553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:16.928098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11429): Terminating (SIGTERM) 10:56:16.973061 run iperf3-srv_10.42.42.10(pid=11430): Terminating (SIGTERM) 10:56:17.019640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11433): Terminating (SIGTERM) 10:56:17.064396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11436): Terminating (SIGTERM) 10:56:17.108755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11439): Terminating (SIGTERM) 10:56:17.153276 --- ParallelTerminationStrategy: PID 11429 died... 10:56:17.175401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11429): Terminated: ok {rc=0} 10:56:17.223390 --- ParallelTerminationStrategy: PID 11430 died... 10:56:17.243451 run iperf3-srv_10.42.42.10(pid=11430): Terminated {rc=256} 10:56:17.289989 --- ParallelTerminationStrategy: PID 11433 died... 10:56:17.310180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11433): Terminated: ok {rc=0} 10:56:17.357028 --- ParallelTerminationStrategy: PID 11436 died... 10:56:17.377927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11436): Terminated: ok {rc=0} 10:56:17.424891 --- ParallelTerminationStrategy: PID 11439 died... 10:56:17.445818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11439): Terminated: ok {rc=0} 10:56:17.535090 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:56:18.685403 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:18.697527 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:56:18.769666 tst iperf3m4.py: using LAC 33461 10:56:18.897610 tst iperf3m4.py: using RAC 56 10:56:19.023961 tst iperf3m4.py: using CellId 33461 10:56:19.151907 tst iperf3m4.py: using BVCI 33462 10:56:19.271492 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:19.282879 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:19.293958 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:19.304875 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:19.316012 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:19.327314 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:19.338840 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:19.350166 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:19.361691 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:19.479831 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:19.603123 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:19.723688 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:19.840551 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:56:20.043678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:20.348695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11441): Launched 10:56:20.614819 run iperf3-srv_10.42.42.10(pid=11442): Launched 10:56:20.730550 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:56:20.932200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:21.234887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11443): Launched 10:56:21.498499 run iperf3-srv_10.42.42.10(pid=11444): Launched 10:56:21.613800 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:56:21.814836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:22.117291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11445): Launched 10:56:22.380092 run iperf3-srv_10.42.42.10(pid=11446): Launched 10:56:22.494943 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:56:22.696835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:22.999398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11447): Launched 10:56:23.262552 run iperf3-srv_10.42.42.10(pid=11448): Launched 10:56:23.378035 tst iperf3m4.py:8: start network... 10:56:23.579727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:24.049475 run create_hlr_db(pid=11449): Launched 10:56:24.178811 bus /gobi_6: Setting Powered False 10:56:25.243014 run create_hlr_db(pid=11449): Terminated: ok {rc=0} 10:56:25.677391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11451): Launched 10:56:25.979494 run osmo-hlr_10.42.42.2(pid=11452): Launched 10:56:26.094776 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:26.616259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11454): Launched 10:56:26.917677 run osmo-stp_10.42.42.5(pid=11455): Launched 10:56:27.032063 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:27.552183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11457): Launched 10:56:27.667441 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:27.923090 run patchelf(pid=11458): Launched 10:56:28.089772 run osmo-stp_10.42.42.5(pid=11455): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11455)] 10:56:28.217323 run osmo-stp_10.42.42.5(pid=11455): stdout: | (launched: 2022-12-13_10:56:26.862101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:28.345694 run osmo-stp_10.42.42.5(pid=11455): stderr: | 20221213105627032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105627032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105627032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105627033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105627035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105627035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105627035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:28.474616 run osmo-stp_10.42.42.5(pid=11455): stdout: | (launched: 2022-12-13_10:56:26.862101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:28.598448 run osmo-stp_10.42.42.5(pid=11455): stderr: | 20221213105627032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105627032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105627032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105627033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105627035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105627035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105627035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:28.744377 run patchelf(pid=11458): Terminating (SIGINT) 10:56:28.913662 run patchelf(pid=11458): Terminated: ok {rc=0} 10:56:29.035802 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11455): Process ended prematurely: osmo-stp_10.42.42.5(pid=11455) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11455)] [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:56:29.045338 tst iperf3m4.py:8: Test FAILED (10.4 sec) 10:56:29.072421 run osmo-hlr_10.42.42.2(pid=11452): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11452)] 10:56:29.120012 run osmo-hlr_10.42.42.2(pid=11452): stdout: | (launched: 2022-12-13_10:56:25.922771) 10:56:29.168898 run osmo-hlr_10.42.42.2(pid=11452): stderr: | 20221213105626102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105626102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105626102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105626103 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105626103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105626103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105626115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105626124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105626124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105626124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:29.218171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11441): Terminating (SIGTERM) 10:56:29.257859 run iperf3-srv_10.42.42.10(pid=11442): Terminating (SIGTERM) 10:56:29.297326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11443): Terminating (SIGTERM) 10:56:29.336800 run iperf3-srv_10.42.42.10(pid=11444): Terminating (SIGTERM) 10:56:29.376163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11445): Terminating (SIGTERM) 10:56:29.415425 run iperf3-srv_10.42.42.10(pid=11446): Terminating (SIGTERM) 10:56:29.454697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11447): Terminating (SIGTERM) 10:56:29.494003 run iperf3-srv_10.42.42.10(pid=11448): Terminating (SIGTERM) 10:56:29.533267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11451): Terminating (SIGTERM) 10:56:29.572537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11454): Terminating (SIGTERM) 10:56:29.611877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11457): Terminating (SIGTERM) 10:56:29.651633 --- ParallelTerminationStrategy: PID 11441 died... 10:56:29.670785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11441): Terminated: ok {rc=0} 10:56:29.714614 --- ParallelTerminationStrategy: PID 11442 died... 10:56:29.733782 run iperf3-srv_10.42.42.10(pid=11442): Terminated {rc=256} 10:56:29.777677 --- ParallelTerminationStrategy: PID 11443 died... 10:56:29.796348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11443): Terminated: ok {rc=0} 10:56:29.840766 --- ParallelTerminationStrategy: PID 11444 died... 10:56:29.859382 run iperf3-srv_10.42.42.10(pid=11444): Terminated {rc=256} 10:56:29.903000 --- ParallelTerminationStrategy: PID 11445 died... 10:56:29.921572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11445): Terminated: ok {rc=0} 10:56:29.965239 --- ParallelTerminationStrategy: PID 11446 died... 10:56:29.983672 run iperf3-srv_10.42.42.10(pid=11446): Terminated {rc=256} 10:56:30.028029 --- ParallelTerminationStrategy: PID 11447 died... 10:56:30.046734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11447): Terminated: ok {rc=0} 10:56:30.090579 --- ParallelTerminationStrategy: PID 11448 died... 10:56:30.109281 run iperf3-srv_10.42.42.10(pid=11448): Terminated {rc=256} 10:56:30.152909 --- ParallelTerminationStrategy: PID 11451 died... 10:56:30.171958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11451): Terminated: ok {rc=0} 10:56:30.215625 --- ParallelTerminationStrategy: PID 11454 died... 10:56:30.234236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11454): Terminated: ok {rc=0} 10:56:30.278024 --- ParallelTerminationStrategy: PID 11457 died... 10:56:30.296659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11457): Terminated: ok {rc=0} 10:56:30.380663 bus /gobi_4: Setting Powered False 10:56:31.476749 bus /gobi_4: Setting Powered False 10:56:32.593975 bus /gobi_1: Setting Powered False 10:56:33.693030 bus /gobi_1: Setting Powered False 10:56:34.810922 bus /gobi_0: Setting Powered False 10:56:35.910692 bus /gobi_0: Setting Powered False 10:56:37.027948 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:56:38.131161 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:38.143181 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:56:38.219109 tst ping.py: using LAC 33462 10:56:38.336450 tst ping.py: using RAC 57 10:56:38.451471 tst ping.py: using CellId 33462 10:56:38.566595 tst ping.py: using BVCI 33463 10:56:38.676670 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:38.687754 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:38.698426 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:38.708928 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:38.719461 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:38.730043 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:38.740680 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:38.751247 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:38.869923 tst ping.py:19: start network... 10:56:39.084247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:39.578904 run create_hlr_db(pid=11459): Launched 10:56:39.700387 bus /gobi_6: Setting Powered False 10:56:40.763788 run create_hlr_db(pid=11459): Terminated: ok {rc=0} 10:56:41.191108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11461): Launched 10:56:41.513279 run osmo-hlr_10.42.42.2(pid=11462): Launched 10:56:41.635587 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:42.189722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11464): Launched 10:56:42.509956 run osmo-stp_10.42.42.5(pid=11465): Launched 10:56:42.633149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:43.182528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11467): Launched 10:56:43.305765 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:43.575407 run patchelf(pid=11468): Launched 10:56:43.754098 run osmo-stp_10.42.42.5(pid=11465): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11465)] 10:56:43.889286 run osmo-stp_10.42.42.5(pid=11465): stdout: | (launched: 2022-12-13_10:56:42.451608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:44.025683 run osmo-stp_10.42.42.5(pid=11465): stderr: | 20221213105642646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105642646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105642646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105642647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105642647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105642647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105642647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:44.162211 run osmo-stp_10.42.42.5(pid=11465): stdout: | (launched: 2022-12-13_10:56:42.451608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:44.292901 run osmo-stp_10.42.42.5(pid=11465): stderr: | 20221213105642646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105642646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105642646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105642647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105642647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105642647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105642647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:44.447639 run patchelf(pid=11468): Terminating (SIGINT) 10:56:44.626072 run patchelf(pid=11468): Terminated: ok {rc=0} 10:56:44.754933 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11465): Process ended prematurely: osmo-stp_10.42.42.5(pid=11465) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11465)] [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 10:56:44.764609 tst ping.py:22: Test FAILED (6.6 sec) 10:56:44.792820 run osmo-hlr_10.42.42.2(pid=11462): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11462)] 10:56:44.843515 run osmo-hlr_10.42.42.2(pid=11462): stdout: | (launched: 2022-12-13_10:56:41.454745) 10:56:44.895758 run osmo-hlr_10.42.42.2(pid=11462): stderr: | 20221213105641654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105641654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105641654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105641654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105641654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105641654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105641677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105641687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105641687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105641687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:44.948749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11461): Terminating (SIGTERM) 10:56:44.991205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11464): Terminating (SIGTERM) 10:56:45.033601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11467): Terminating (SIGTERM) 10:56:45.076212 --- ParallelTerminationStrategy: PID 11461 died... 10:56:45.096831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11461): Terminated: ok {rc=0} 10:56:45.143685 --- ParallelTerminationStrategy: PID 11464 died... 10:56:45.163784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11464): Terminated: ok {rc=0} 10:56:45.210438 --- ParallelTerminationStrategy: PID 11467 died... 10:56:45.230640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11467): Terminated: ok {rc=0} 10:56:45.318773 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:56:46.420246 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:46.433556 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:56:46.513241 tst ping_idle_ping.py: using LAC 33463 10:56:46.646623 tst ping_idle_ping.py: using RAC 58 10:56:46.783079 tst ping_idle_ping.py: using CellId 33463 10:56:46.918184 tst ping_idle_ping.py: using BVCI 33464 10:56:47.046620 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:47.058545 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:47.069987 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:47.081299 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:47.093169 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:47.105230 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:47.117227 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:56:47.129108 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:56:47.246078 tst ping_idle_ping.py:24: start network... 10:56:47.446181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:47.911886 run create_hlr_db(pid=11469): Launched 10:56:48.034672 bus /gobi_6: Setting Powered False 10:56:49.094549 run create_hlr_db(pid=11469): Terminated: ok {rc=0} 10:56:49.534530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11471): Launched 10:56:49.856373 run osmo-hlr_10.42.42.2(pid=11472): Launched 10:56:49.978572 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:50.528550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11474): Launched 10:56:50.848209 run osmo-stp_10.42.42.5(pid=11475): Launched 10:56:50.970306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:51.523220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11477): Launched 10:56:51.647384 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:51.918698 run patchelf(pid=11478): Launched 10:56:52.098098 run osmo-stp_10.42.42.5(pid=11475): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11475)] 10:56:52.234010 run osmo-stp_10.42.42.5(pid=11475): stdout: | (launched: 2022-12-13_10:56:50.789682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:52.371458 run osmo-stp_10.42.42.5(pid=11475): stderr: | 20221213105650981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105650981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105650981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105650982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105650984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105650984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105650984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:52.509488 run osmo-stp_10.42.42.5(pid=11475): stdout: | (launched: 2022-12-13_10:56:50.789682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:52.641380 run osmo-stp_10.42.42.5(pid=11475): stderr: | 20221213105650981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105650981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105650981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105650982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105650984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105650984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105650984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:52.797623 run patchelf(pid=11478): Terminating (SIGINT) 10:56:52.977582 run patchelf(pid=11478): Terminated: ok {rc=0} 10:56:53.107052 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11475): Process ended prematurely: osmo-stp_10.42.42.5(pid=11475) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11475)] [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:56:53.116493 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:56:53.144419 run osmo-hlr_10.42.42.2(pid=11472): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11472)] 10:56:53.195620 run osmo-hlr_10.42.42.2(pid=11472): stdout: | (launched: 2022-12-13_10:56:49.797663) 10:56:53.248387 run osmo-hlr_10.42.42.2(pid=11472): stderr: | 20221213105649995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105649995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105649995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105649995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105649995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105649995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105650028 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105650038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105650039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105650039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:53.301507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11471): Terminating (SIGTERM) 10:56:53.344068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11474): Terminating (SIGTERM) 10:56:53.386565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11477): Terminating (SIGTERM) 10:56:53.429721 --- ParallelTerminationStrategy: PID 11471 died... 10:56:53.450647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11471): Terminated: ok {rc=0} 10:56:53.497762 --- ParallelTerminationStrategy: PID 11474 died... 10:56:53.518283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11474): Terminated: ok {rc=0} 10:56:53.565209 --- ParallelTerminationStrategy: PID 11477 died... 10:56:53.585540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11477): Terminated: ok {rc=0} 10:56:53.674685 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:56:54.976300 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:56:54.982811 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:56:55.015356 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:56:55.053566 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:56:55.139534 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:56:55.173229 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:56:55.212790 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:56:55.801975 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:56:55.858374 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:56:55.869826 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:56:55.941631 tst cs_paging_gprs_active.py: using LAC 33464 10:56:56.071271 tst cs_paging_gprs_active.py: using RAC 59 10:56:56.201322 tst cs_paging_gprs_active.py: using CellId 33464 10:56:56.330974 tst cs_paging_gprs_active.py: using BVCI 33465 10:56:56.452277 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:56:56.463862 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:56:56.475143 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:56:56.486428 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:56:56.498168 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:56:56.510028 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:56:56.521919 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:56:56.533571 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:56:56.545435 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:56:56.664127 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:56:56.787582 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:56:56.991305 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:57.295753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11483): Launched 10:56:57.560484 run iperf3-srv_10.42.42.10(pid=11484): Launched 10:56:57.675892 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:56:57.879771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:58.184584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11485): Launched 10:56:58.448073 run iperf3-srv_10.42.42.10(pid=11486): Launched 10:56:58.561559 tst cs_paging_gprs_active.py:38: start network... 10:56:58.764879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:59.235904 run create_hlr_db(pid=11487): Launched 10:56:59.360165 bus /gobi_6: Setting Powered False 10:57:00.421619 run create_hlr_db(pid=11487): Terminated: ok {rc=0} 10:57:00.877340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11489): Launched 10:57:01.215273 run osmo-hlr_10.42.42.2(pid=11490): Launched 10:57:01.454978 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:02.109717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11492): Launched 10:57:02.429437 run osmo-stp_10.42.42.5(pid=11493): Launched 10:57:02.545739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:03.070207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11495): Launched 10:57:03.209515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:03.466608 run patchelf(pid=11496): Launched 10:57:03.636439 run osmo-stp_10.42.42.5(pid=11493): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11493)] 10:57:03.764670 run osmo-stp_10.42.42.5(pid=11493): stdout: | (launched: 2022-12-13_10:57:02.373503) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:03.894372 run osmo-stp_10.42.42.5(pid=11493): stderr: | 20221213105702543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105702544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105702544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105702544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105702547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105702547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105702547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:04.024083 run osmo-stp_10.42.42.5(pid=11493): stdout: | (launched: 2022-12-13_10:57:02.373503) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:04.148013 run osmo-stp_10.42.42.5(pid=11493): stderr: | 20221213105702543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105702544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105702544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105702544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105702547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105702547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105702547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:04.295081 run patchelf(pid=11496): Terminating (SIGINT) 10:57:04.466789 run patchelf(pid=11496): Terminated: ok {rc=0} 10:57:04.589977 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11493): Process ended prematurely: osmo-stp_10.42.42.5(pid=11493) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11493)] [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:57:04.599313 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:57:04.626063 run osmo-hlr_10.42.42.2(pid=11490): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11490)] 10:57:04.672885 run osmo-hlr_10.42.42.2(pid=11490): stdout: | (launched: 2022-12-13_10:57:01.157576) 10:57:04.721633 run osmo-hlr_10.42.42.2(pid=11490): stderr: | 20221213105701500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105701500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105701500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105701500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105701500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105701500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105701532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105701544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105701544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105701544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:04.770667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11483): Terminating (SIGTERM) 10:57:04.810799 run iperf3-srv_10.42.42.10(pid=11484): Terminating (SIGTERM) 10:57:04.850077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11485): Terminating (SIGTERM) 10:57:04.889141 run iperf3-srv_10.42.42.10(pid=11486): Terminating (SIGTERM) 10:57:04.928041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11489): Terminating (SIGTERM) 10:57:04.967180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11492): Terminating (SIGTERM) 10:57:05.006213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11495): Terminating (SIGTERM) 10:57:05.046051 --- ParallelTerminationStrategy: PID 11483 died... 10:57:05.065070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11483): Terminated: ok {rc=0} 10:57:05.108345 --- ParallelTerminationStrategy: PID 11484 died... 10:57:05.126736 run iperf3-srv_10.42.42.10(pid=11484): Terminated {rc=256} 10:57:05.169901 --- ParallelTerminationStrategy: PID 11485 died... 10:57:05.188463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11485): Terminated: ok {rc=0} 10:57:05.231942 --- ParallelTerminationStrategy: PID 11486 died... 10:57:05.250370 run iperf3-srv_10.42.42.10(pid=11486): Terminated {rc=256} 10:57:05.293612 --- ParallelTerminationStrategy: PID 11489 died... 10:57:05.312013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11489): Terminated: ok {rc=0} 10:57:05.355478 --- ParallelTerminationStrategy: PID 11492 died... 10:57:05.373938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11492): Terminated: ok {rc=0} 10:57:05.417252 --- ParallelTerminationStrategy: PID 11495 died... 10:57:05.435606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11495): Terminated: ok {rc=0} 10:57:05.519116 bus /gobi_0: Setting Powered False 10:57:06.619609 bus /gobi_0: Setting Powered False 10:57:07.735139 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:57:08.883840 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:08.896293 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:57:08.968679 tst iperf3.py: using LAC 33465 10:57:09.098290 tst iperf3.py: using RAC 60 10:57:09.224565 tst iperf3.py: using CellId 33465 10:57:09.351652 tst iperf3.py: using BVCI 33466 10:57:09.463299 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:09.474261 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:09.485142 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:09.495899 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:09.506469 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:09.517859 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:09.529127 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:09.540318 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:09.551306 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:57:09.665823 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:57:09.869748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:10.174935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11497): Launched 10:57:10.469674 run iperf3-srv_10.42.42.10(pid=11498): Launched 10:57:10.593442 tst iperf3.py:8: start network... 10:57:10.812441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:11.317791 run create_hlr_db(pid=11499): Launched 10:57:11.442551 bus /gobi_6: Setting Powered False 10:57:12.506692 run create_hlr_db(pid=11499): Terminated: ok {rc=0} 10:57:12.959487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11501): Launched 10:57:13.286755 run osmo-hlr_10.42.42.2(pid=11502): Launched 10:57:13.411481 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:13.972879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11504): Launched 10:57:14.297787 run osmo-stp_10.42.42.5(pid=11505): Launched 10:57:14.423521 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:14.982297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11507): Launched 10:57:15.107619 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:15.381486 run patchelf(pid=11508): Launched 10:57:15.561479 run osmo-stp_10.42.42.5(pid=11505): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11505)] 10:57:15.698138 run osmo-stp_10.42.42.5(pid=11505): stdout: | (launched: 2022-12-13_10:57:14.238675) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:15.836281 run osmo-stp_10.42.42.5(pid=11505): stderr: | 20221213105714433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105714433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105714433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105714434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105714436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105714436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105714436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:15.998593 run osmo-stp_10.42.42.5(pid=11505): stdout: | (launched: 2022-12-13_10:57:14.238675) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:16.133909 run osmo-stp_10.42.42.5(pid=11505): stderr: | 20221213105714433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105714433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105714433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105714434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105714436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105714436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105714436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:16.295614 run patchelf(pid=11508): Terminating (SIGINT) 10:57:16.482462 run patchelf(pid=11508): Terminated: ok {rc=0} 10:57:16.628500 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11505): Process ended prematurely: osmo-stp_10.42.42.5(pid=11505) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11505)] [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 10:57:16.642175 tst iperf3.py:8: Test FAILED (7.8 sec) 10:57:16.678292 run osmo-hlr_10.42.42.2(pid=11502): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11502)] 10:57:16.737380 run osmo-hlr_10.42.42.2(pid=11502): stdout: | (launched: 2022-12-13_10:57:13.226843) 10:57:16.798198 run osmo-hlr_10.42.42.2(pid=11502): stderr: | 20221213105713426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105713426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105713427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105713427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105713427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105713427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105713438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105713447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105713447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105713447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:16.862049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11497): Terminating (SIGTERM) 10:57:16.909591 run iperf3-srv_10.42.42.10(pid=11498): Terminating (SIGTERM) 10:57:16.955266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11501): Terminating (SIGTERM) 10:57:16.996668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11504): Terminating (SIGTERM) 10:57:17.040874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11507): Terminating (SIGTERM) 10:57:17.084477 --- ParallelTerminationStrategy: PID 11497 died... 10:57:17.104485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11497): Terminated: ok {rc=0} 10:57:17.151484 --- ParallelTerminationStrategy: PID 11498 died... 10:57:17.170974 run iperf3-srv_10.42.42.10(pid=11498): Terminated {rc=256} 10:57:17.217321 --- ParallelTerminationStrategy: PID 11501 died... 10:57:17.237165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11501): Terminated: ok {rc=0} 10:57:17.282022 --- ParallelTerminationStrategy: PID 11504 died... 10:57:17.301579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11504): Terminated: ok {rc=0} 10:57:17.346188 --- ParallelTerminationStrategy: PID 11507 died... 10:57:17.365003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11507): Terminated: ok {rc=0} 10:57:17.452011 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:57:18.600531 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:18.612068 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:57:18.681951 tst iperf3m4.py: using LAC 33466 10:57:18.802598 tst iperf3m4.py: using RAC 61 10:57:18.922404 tst iperf3m4.py: using CellId 33466 10:57:19.042679 tst iperf3m4.py: using BVCI 33467 10:57:19.154374 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:19.165173 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:19.175871 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:19.186445 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:19.196880 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:19.207641 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:19.218865 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:19.229888 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:19.241393 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:57:19.358183 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:57:19.481530 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:57:19.599508 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:57:19.718852 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:57:19.922752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:20.228648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11509): Launched 10:57:20.493337 run iperf3-srv_10.42.42.10(pid=11510): Launched 10:57:20.606622 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:57:20.809940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:21.116415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11511): Launched 10:57:21.381114 run iperf3-srv_10.42.42.10(pid=11512): Launched 10:57:21.494479 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:57:21.696561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:22.000666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11513): Launched 10:57:22.264833 run iperf3-srv_10.42.42.10(pid=11514): Launched 10:57:22.378227 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:57:22.580712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:22.884460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11515): Launched 10:57:23.148686 run iperf3-srv_10.42.42.10(pid=11516): Launched 10:57:23.262119 tst iperf3m4.py:8: start network... 10:57:23.464218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:23.933092 run create_hlr_db(pid=11517): Launched 10:57:24.055704 bus /gobi_6: Setting Powered False 10:57:25.117057 run create_hlr_db(pid=11517): Terminated: ok {rc=0} 10:57:25.559881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11519): Launched 10:57:25.887852 run osmo-hlr_10.42.42.2(pid=11520): Launched 10:57:26.013891 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:26.579614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11522): Launched 10:57:26.905289 run osmo-stp_10.42.42.5(pid=11523): Launched 10:57:27.029048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:27.588365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11525): Launched 10:57:27.712109 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:27.987027 run patchelf(pid=11526): Launched 10:57:28.166756 run osmo-stp_10.42.42.5(pid=11523): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11523)] 10:57:28.303702 run osmo-stp_10.42.42.5(pid=11523): stdout: | (launched: 2022-12-13_10:57:26.845495) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:28.442992 run osmo-stp_10.42.42.5(pid=11523): stderr: | 20221213105727042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105727042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105727042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105727042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105727043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105727043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105727043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:28.581593 run osmo-stp_10.42.42.5(pid=11523): stdout: | (launched: 2022-12-13_10:57:26.845495) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:28.714503 run osmo-stp_10.42.42.5(pid=11523): stderr: | 20221213105727042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105727042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105727042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105727042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105727043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105727043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105727043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:28.871840 run patchelf(pid=11526): Terminating (SIGINT) 10:57:29.054233 run patchelf(pid=11526): Terminated: ok {rc=0} 10:57:29.185910 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11523): Process ended prematurely: osmo-stp_10.42.42.5(pid=11523) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11523)] [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:57:29.195941 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:57:29.224854 run osmo-hlr_10.42.42.2(pid=11520): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11520)] 10:57:29.275805 run osmo-hlr_10.42.42.2(pid=11520): stdout: | (launched: 2022-12-13_10:57:25.828355) 10:57:29.327993 run osmo-hlr_10.42.42.2(pid=11520): stderr: | 20221213105726029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105726029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105726029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105726029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105726029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105726029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105726041 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105726050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105726050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105726050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:29.380475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11509): Terminating (SIGTERM) 10:57:29.423151 run iperf3-srv_10.42.42.10(pid=11510): Terminating (SIGTERM) 10:57:29.466506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11511): Terminating (SIGTERM) 10:57:29.509202 run iperf3-srv_10.42.42.10(pid=11512): Terminating (SIGTERM) 10:57:29.551123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11513): Terminating (SIGTERM) 10:57:29.593054 run iperf3-srv_10.42.42.10(pid=11514): Terminating (SIGTERM) 10:57:29.635601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11515): Terminating (SIGTERM) 10:57:29.678278 run iperf3-srv_10.42.42.10(pid=11516): Terminating (SIGTERM) 10:57:29.720292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11519): Terminating (SIGTERM) 10:57:29.762471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11522): Terminating (SIGTERM) 10:57:29.804653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11525): Terminating (SIGTERM) 10:57:29.847419 --- ParallelTerminationStrategy: PID 11509 died... 10:57:29.867822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11509): Terminated: ok {rc=0} 10:57:29.914807 --- ParallelTerminationStrategy: PID 11510 died... 10:57:29.934718 run iperf3-srv_10.42.42.10(pid=11510): Terminated {rc=256} 10:57:29.980919 --- ParallelTerminationStrategy: PID 11511 died... 10:57:30.000826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11511): Terminated: ok {rc=0} 10:57:30.047314 --- ParallelTerminationStrategy: PID 11512 died... 10:57:30.067278 run iperf3-srv_10.42.42.10(pid=11512): Terminated {rc=256} 10:57:30.113444 --- ParallelTerminationStrategy: PID 11513 died... 10:57:30.133466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11513): Terminated: ok {rc=0} 10:57:30.179746 --- ParallelTerminationStrategy: PID 11514 died... 10:57:30.199575 run iperf3-srv_10.42.42.10(pid=11514): Terminated {rc=256} 10:57:30.245744 --- ParallelTerminationStrategy: PID 11515 died... 10:57:30.265566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11515): Terminated: ok {rc=0} 10:57:30.311803 --- ParallelTerminationStrategy: PID 11516 died... 10:57:30.331609 run iperf3-srv_10.42.42.10(pid=11516): Terminated {rc=256} 10:57:30.377751 --- ParallelTerminationStrategy: PID 11519 died... 10:57:30.397706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11519): Terminated: ok {rc=0} 10:57:30.444171 --- ParallelTerminationStrategy: PID 11522 died... 10:57:30.464205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11522): Terminated: ok {rc=0} 10:57:30.510409 --- ParallelTerminationStrategy: PID 11525 died... 10:57:30.530401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11525): Terminated: ok {rc=0} 10:57:30.618626 bus /gobi_4: Setting Powered False 10:57:31.720282 bus /gobi_4: Setting Powered False 10:57:32.835708 bus /gobi_1: Setting Powered False 10:57:33.934481 bus /gobi_1: Setting Powered False 10:57:35.050729 bus /gobi_0: Setting Powered False 10:57:36.150069 bus /gobi_0: Setting Powered False 10:57:37.266316 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:57:38.370025 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:38.382015 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:57:38.454830 tst ping.py: using LAC 33467 10:57:38.578553 tst ping.py: using RAC 62 10:57:38.704866 tst ping.py: using CellId 33467 10:57:38.822247 tst ping.py: using BVCI 33468 10:57:38.931833 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:38.942958 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:38.953833 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:38.964672 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:38.975412 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:38.986252 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:38.997010 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:39.008083 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:57:39.125516 tst ping.py:19: start network... 10:57:39.324389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:39.785473 run create_hlr_db(pid=11527): Launched 10:57:39.907683 bus /gobi_6: Setting Powered False 10:57:40.967975 run create_hlr_db(pid=11527): Terminated: ok {rc=0} 10:57:41.386135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11529): Launched 10:57:41.686483 run osmo-hlr_10.42.42.2(pid=11530): Launched 10:57:41.799288 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:42.313989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11532): Launched 10:57:42.612404 run osmo-stp_10.42.42.5(pid=11533): Launched 10:57:42.725582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:43.239589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11535): Launched 10:57:43.353319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:43.605104 run patchelf(pid=11536): Launched 10:57:43.769971 run osmo-stp_10.42.42.5(pid=11533): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11533)] 10:57:43.896233 run osmo-stp_10.42.42.5(pid=11533): stdout: | (launched: 2022-12-13_10:57:42.557398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:44.023239 run osmo-stp_10.42.42.5(pid=11533): stderr: | 20221213105742730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105742730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105742730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105742731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105742731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105742731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105742731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:44.150519 run osmo-stp_10.42.42.5(pid=11533): stdout: | (launched: 2022-12-13_10:57:42.557398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:44.272193 run osmo-stp_10.42.42.5(pid=11533): stderr: | 20221213105742730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105742730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105742730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105742731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105742731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105742731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105742731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:44.416565 run patchelf(pid=11536): Terminating (SIGINT) 10:57:44.584439 run patchelf(pid=11536): Terminated: ok {rc=0} 10:57:44.704772 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11533): Process ended prematurely: osmo-stp_10.42.42.5(pid=11533) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11533)] [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 10:57:44.713682 tst ping.py:22: Test FAILED (6.3 sec) 10:57:44.740482 run osmo-hlr_10.42.42.2(pid=11530): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11530)] 10:57:44.788224 run osmo-hlr_10.42.42.2(pid=11530): stdout: | (launched: 2022-12-13_10:57:41.631146) 10:57:44.837405 run osmo-hlr_10.42.42.2(pid=11530): stderr: | 20221213105741808 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105741808 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105741808 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105741808 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105741808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105741808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105741820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105741829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105741829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105741829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:44.886930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11529): Terminating (SIGTERM) 10:57:44.926612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11532): Terminating (SIGTERM) 10:57:44.965919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11535): Terminating (SIGTERM) 10:57:45.005766 --- ParallelTerminationStrategy: PID 11529 died... 10:57:45.024858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11529): Terminated: ok {rc=0} 10:57:45.069223 --- ParallelTerminationStrategy: PID 11532 died... 10:57:45.087848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11532): Terminated: ok {rc=0} 10:57:45.132041 --- ParallelTerminationStrategy: PID 11535 died... 10:57:45.150997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11535): Terminated: ok {rc=0} 10:57:45.235827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:57:46.322328 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:46.335379 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:57:46.410925 tst ping_idle_ping.py: using LAC 33468 10:57:46.532827 tst ping_idle_ping.py: using RAC 63 10:57:46.660687 tst ping_idle_ping.py: using CellId 33468 10:57:46.788583 tst ping_idle_ping.py: using BVCI 33469 10:57:46.938259 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:46.949785 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:46.961578 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:46.973409 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:46.985763 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:46.998361 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:47.010837 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:57:47.023266 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:57:47.140253 tst ping_idle_ping.py:24: start network... 10:57:47.359861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:47.858811 run create_hlr_db(pid=11537): Launched 10:57:47.983015 bus /gobi_6: Setting Powered False 10:57:49.046637 run create_hlr_db(pid=11537): Terminated: ok {rc=0} 10:57:49.477419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11539): Launched 10:57:49.776942 run osmo-hlr_10.42.42.2(pid=11540): Launched 10:57:49.890239 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:50.418608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11542): Launched 10:57:50.715106 run osmo-stp_10.42.42.5(pid=11543): Launched 10:57:50.828009 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:51.342184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11545): Launched 10:57:51.455616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:51.707291 run patchelf(pid=11546): Launched 10:57:51.872388 run osmo-stp_10.42.42.5(pid=11543): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11543)] 10:57:51.999858 run osmo-stp_10.42.42.5(pid=11543): stdout: | (launched: 2022-12-13_10:57:50.659999) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:52.127586 run osmo-stp_10.42.42.5(pid=11543): stderr: | 20221213105750830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105750830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105750831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105750831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105750831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105750831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105750832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:52.255207 run osmo-stp_10.42.42.5(pid=11543): stdout: | (launched: 2022-12-13_10:57:50.659999) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:52.377142 run osmo-stp_10.42.42.5(pid=11543): stderr: | 20221213105750830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105750830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105750831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105750831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105750831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105750831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105750832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:52.521908 run patchelf(pid=11546): Terminating (SIGINT) 10:57:52.689629 run patchelf(pid=11546): Terminated: ok {rc=0} 10:57:52.810523 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11543): Process ended prematurely: osmo-stp_10.42.42.5(pid=11543) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11543)] [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:57:52.819453 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:57:52.846255 run osmo-hlr_10.42.42.2(pid=11540): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11540)] 10:57:52.894034 run osmo-hlr_10.42.42.2(pid=11540): stdout: | (launched: 2022-12-13_10:57:49.721659) 10:57:52.943660 run osmo-hlr_10.42.42.2(pid=11540): stderr: | 20221213105749901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105749901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105749901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105749901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105749901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105749901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105749914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105749924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105749924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105749924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:52.993849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11539): Terminating (SIGTERM) 10:57:53.033863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11542): Terminating (SIGTERM) 10:57:53.073827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11545): Terminating (SIGTERM) 10:57:53.114143 --- ParallelTerminationStrategy: PID 11539 died... 10:57:53.133449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11539): Terminated: ok {rc=0} 10:57:53.177642 --- ParallelTerminationStrategy: PID 11542 died... 10:57:53.196763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11542): Terminated: ok {rc=0} 10:57:53.241057 --- ParallelTerminationStrategy: PID 11545 died... 10:57:53.259829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11545): Terminated: ok {rc=0} 10:57:53.346402 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:57:54.648713 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:57:54.657864 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:57:54.691832 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:57:54.728755 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:57:54.783043 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:57:54.816498 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:57:54.852274 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:57:55.407569 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:57:55.413451 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:57:55.425209 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:57:55.491621 tst switch_tch_pdch.py: using LAC 33469 10:57:55.606188 tst switch_tch_pdch.py: using RAC 64 10:57:55.721355 tst switch_tch_pdch.py: using CellId 33469 10:57:55.845650 tst switch_tch_pdch.py: using BVCI 33470 10:57:55.954157 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:57:55.965264 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:57:55.976201 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:57:55.987096 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:57:55.998070 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:57:56.009141 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:57:56.020099 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:57:56.030966 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:57:56.152595 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:57:56.278997 tst switch_tch_pdch.py:51: start network... 10:57:56.495099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:56.988377 run create_hlr_db(pid=11550): Launched 10:57:57.112754 bus /gobi_6: Setting Powered False 10:57:58.176148 run create_hlr_db(pid=11550): Terminated: ok {rc=0} 10:57:58.622055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11552): Launched 10:57:58.942041 run osmo-hlr_10.42.42.2(pid=11553): Launched 10:57:59.065995 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:59.618782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11555): Launched 10:57:59.937364 run osmo-stp_10.42.42.5(pid=11556): Launched 10:58:00.060461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:58:00.611438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11558): Launched 10:58:00.733514 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:58:01.007939 run patchelf(pid=11559): Launched 10:58:01.198534 run osmo-stp_10.42.42.5(pid=11556): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11556)] 10:58:01.330132 run osmo-stp_10.42.42.5(pid=11556): stdout: | (launched: 2022-12-13_10:57:59.879436) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:01.463848 run osmo-stp_10.42.42.5(pid=11556): stderr: | 20221213105800071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105800071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105800071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105800072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105800072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105800072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105800072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:01.596393 run osmo-stp_10.42.42.5(pid=11556): stdout: | (launched: 2022-12-13_10:57:59.879436) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:01.723868 run osmo-stp_10.42.42.5(pid=11556): stderr: | 20221213105800071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105800071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105800071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105800072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105800072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105800072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105800072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:01.873932 run patchelf(pid=11559): Terminating (SIGINT) 10:58:02.046306 run patchelf(pid=11559): Terminated: ok {rc=0} 10:58:02.172479 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11556): Process ended prematurely: osmo-stp_10.42.42.5(pid=11556) [trial-2388↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11556)] [trial-2388↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:58:02.182293 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 10:58:02.210056 run osmo-hlr_10.42.42.2(pid=11553): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11553)] 10:58:02.260719 run osmo-hlr_10.42.42.2(pid=11553): stdout: | (launched: 2022-12-13_10:57:58.883823) 10:58:02.310555 run osmo-hlr_10.42.42.2(pid=11553): stderr: | 20221213105759082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105759082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105759082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105759082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105759082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105759082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105759094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105759102 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105759103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105759103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:02.360879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11552): Terminating (SIGTERM) 10:58:02.400848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11555): Terminating (SIGTERM) 10:58:02.441043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11558): Terminating (SIGTERM) 10:58:02.481435 --- ParallelTerminationStrategy: PID 11552 died... 10:58:02.500864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11552): Terminated: ok {rc=0} 10:58:02.545337 --- ParallelTerminationStrategy: PID 11555 died... 10:58:02.564308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11555): Terminated: ok {rc=0} 10:58:02.609190 --- ParallelTerminationStrategy: PID 11558 died... 10:58:02.628387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11558): Terminated: ok {rc=0} 10:58:02.715063 bus /gobi_0: Setting Powered False 10:58:03.815471 bus /gobi_0: Setting Powered False 10:58:04.930131 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:58:06.178274 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:58:06.183930 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:58:06.216233 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:58:06.250482 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:58:06.303482 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:58:06.337045 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:58:06.372690 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:58:06.926473 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:58:06.931837 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:58:06.943067 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:58:07.014294 tst switch_tch_pdch.py: using LAC 33470 10:58:07.139603 tst switch_tch_pdch.py: using RAC 65 10:58:07.263531 tst switch_tch_pdch.py: using CellId 33470 10:58:07.389642 tst switch_tch_pdch.py: using BVCI 33471 10:58:07.505715 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:58:07.517106 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:58:07.528195 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:58:07.539254 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:58:07.550283 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:58:07.561700 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:58:07.573214 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:58:07.584606 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:58:07.700722 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:58:07.820712 tst switch_tch_pdch.py:51: start network... 10:58:08.035945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:08.501913 run create_hlr_db(pid=11565): Launched 10:58:08.624831 bus /gobi_6: Setting Powered False 10:58:09.688099 run create_hlr_db(pid=11565): Terminated: ok {rc=0} 10:58:10.088138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11567): Launched 10:58:10.384937 run osmo-hlr_10.42.42.2(pid=11568): Launched 10:58:10.497892 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:11.001558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11570): Launched 10:58:11.298250 run osmo-stp_10.42.42.5(pid=11571): Launched 10:58:11.411355 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:58:11.897751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11573): Launched 10:58:12.010690 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:58:12.262248 run patchelf(pid=11574): Launched 10:58:12.426917 run osmo-stp_10.42.42.5(pid=11571): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11571)] 10:58:12.552332 run osmo-stp_10.42.42.5(pid=11571): stdout: | (launched: 2022-12-13_10:58:11.243168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:12.679475 run osmo-stp_10.42.42.5(pid=11571): stderr: | 20221213105811412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105811412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105811413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105811413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105811414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105811414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105811414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:12.806388 run osmo-stp_10.42.42.5(pid=11571): stdout: | (launched: 2022-12-13_10:58:11.243168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:12.928088 run osmo-stp_10.42.42.5(pid=11571): stderr: | 20221213105811412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105811412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105811413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105811413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105811414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105811414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105811414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:13.071649 run patchelf(pid=11574): Terminating (SIGINT) 10:58:13.239718 run patchelf(pid=11574): Terminated: ok {rc=0} 10:58:13.360677 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11571): Process ended prematurely: osmo-stp_10.42.42.5(pid=11571) [trial-2388↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11571)] [trial-2388↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:58:13.369739 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 10:58:13.396273 run osmo-hlr_10.42.42.2(pid=11568): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11568)] 10:58:13.443655 run osmo-hlr_10.42.42.2(pid=11568): stdout: | (launched: 2022-12-13_10:58:10.329884) 10:58:13.492823 run osmo-hlr_10.42.42.2(pid=11568): stderr: | 20221213105810509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105810509 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105810509 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105810509 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105810509 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105810510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105810522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105810530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105810530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105810530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:13.542849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11567): Terminating (SIGTERM) 10:58:13.582380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11570): Terminating (SIGTERM) 10:58:13.621762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11573): Terminating (SIGTERM) 10:58:13.661332 --- ParallelTerminationStrategy: PID 11567 died... 10:58:13.680385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11567): Terminated: ok {rc=0} 10:58:13.723825 --- ParallelTerminationStrategy: PID 11570 died... 10:58:13.742271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11570): Terminated: ok {rc=0} 10:58:13.785480 --- ParallelTerminationStrategy: PID 11573 died... 10:58:13.803946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11573): Terminated: ok {rc=0} 10:58:13.888602 bus /gobi_0: Setting Powered False 10:58:14.986710 bus /gobi_0: Setting Powered False 10:58:16.101357 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 10:58:17.356893 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:58:17.361249 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:58:17.391055 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 10:58:17.398383 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 10:58:17.454043 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:58:17.482916 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 10:58:17.489763 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 10:58:18.026646 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 10:58:18.031877 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 10:58:18.042765 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:58:18.086745 tst mo_mt_sms.py: using LAC 33471 10:58:18.205329 tst mo_mt_sms.py: using RAC 66 10:58:18.321495 tst mo_mt_sms.py: using CellId 33471 10:58:18.437166 tst mo_mt_sms.py: using BVCI 33472 10:58:18.544177 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:58:18.663866 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:58:18.778596 tst mo_mt_sms.py:9: start nitb and bts... 10:58:18.978531 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:58:19.584910 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11578): Launched 10:58:19.881374 run osmo-nitb_10.42.42.2(pid=11579): Launched 10:58:20.046374 run osmo-nitb_10.42.42.2(pid=11579): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11579)] 10:58:20.180532 run osmo-nitb_10.42.42.2(pid=11579): stdout: | (launched: 2022-12-13_10:58:19.826528) 10:58:20.315352 run osmo-nitb_10.42.42.2(pid=11579): stderr: | (launched: 2022-12-13_10:58:19.870554) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:58:20.450449 run osmo-nitb_10.42.42.2(pid=11579): stdout: | (launched: 2022-12-13_10:58:19.826528) 10:58:20.579523 run osmo-nitb_10.42.42.2(pid=11579): stderr: | (launched: 2022-12-13_10:58:19.870554) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11579): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11579) [trial-2388↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11579)] 10:58:20.993560 tst osmo-nitb_10.42.42.2(pid=11579): stdout: | (launched: 2022-12-13_10:58:19.826528) 10:58:21.113655 tst osmo-nitb_10.42.42.2(pid=11579): stderr: | (launched: 2022-12-13_10:58:19.870554) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:58:21.254648 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=11579): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11579) [trial-2388↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11579)] [trial-2388↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 10:58:21.262887 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 10:58:21.269292 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11578): Terminating (SIGTERM) 10:58:21.477372 --- ParallelTerminationStrategy: PID 11578 died... 10:58:21.497367 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11578): Terminated: ok {rc=0} 10:58:21.580680 bus /sierra_3: Setting Powered False 10:58:22.682274 bus /sierra_3: Setting Powered False 10:58:23.798575 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 10:58:24.994665 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:58:24.999079 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:58:25.028557 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 10:58:25.056651 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 10:58:25.111426 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:58:25.140479 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 10:58:25.166841 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 10:58:25.714706 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 10:58:25.719937 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:58:25.731003 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:58:25.775418 tst mo_mt_sms.py: using LAC 33472 10:58:25.899801 tst mo_mt_sms.py: using RAC 67 10:58:26.022527 tst mo_mt_sms.py: using CellId 33472 10:58:26.138218 tst mo_mt_sms.py: using BVCI 33473 10:58:26.247495 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:58:26.258293 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:58:26.268847 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:58:26.279318 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:58:26.289803 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:58:26.300476 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:58:26.420253 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:58:26.540331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:27.035091 run create_hlr_db(pid=11583): Launched 10:58:27.157411 bus /sierra_2: Setting Powered False 10:58:28.221444 run create_hlr_db(pid=11583): Terminated: ok {rc=0} 10:58:28.646696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11585): Launched 10:58:28.943298 run osmo-hlr_10.42.42.2(pid=11586): Launched 10:58:29.056123 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:29.584782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11588): Launched 10:58:29.882774 run osmo-stp_10.42.42.5(pid=11589): Launched 10:58:29.995999 run osmo-msc_10.42.42.6: Starting osmo-msc 10:58:30.536357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11591): Launched 10:58:30.833799 run osmo-msc_10.42.42.6(pid=11592): Launched 10:58:31.190148 run osmo-stp_10.42.42.5(pid=11589): ERR: Terminated: ERROR {rc=1} [trial-2388↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11589)] 10:58:31.470753 run osmo-stp_10.42.42.5(pid=11589): stdout: | (launched: 2022-12-13_10:58:29.826985) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:31.623058 run osmo-stp_10.42.42.5(pid=11589): stderr: | 20221213105829999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105829999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105829999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105829999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105830000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105830000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105830000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:31.749892 run osmo-stp_10.42.42.5(pid=11589): stdout: | (launched: 2022-12-13_10:58:29.826985) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:31.870621 run osmo-stp_10.42.42.5(pid=11589): stderr: | 20221213105829999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105829999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105829999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105829999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105830000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105830000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105830000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:32.015588 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=11589): Process ended prematurely: osmo-stp_10.42.42.5(pid=11589) [trial-2388↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11589)] [trial-2388↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 10:58:32.024432 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 10:58:32.051426 run osmo-hlr_10.42.42.2(pid=11586): ERR: Terminated: ERROR {rc=237} [trial-2388↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11586)] 10:58:32.101130 run osmo-hlr_10.42.42.2(pid=11586): stdout: | (launched: 2022-12-13_10:58:28.888321) 10:58:32.151486 run osmo-hlr_10.42.42.2(pid=11586): stderr: | 20221213105829066 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105829066 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105829066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105829066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105829066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105829066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105829078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105829087 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105829087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105829088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:32.223027 run osmo-msc_10.42.42.6(pid=11592): ERR: Terminated: ERROR {rc=2} [trial-2388↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11592)] 10:58:32.272109 run osmo-msc_10.42.42.6(pid=11592): stdout: | (launched: 2022-12-13_10:58:30.778679) 10:58:32.322918 run osmo-msc_10.42.42.6(pid=11592): stderr: | 20221213105831208 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105831208 DLGLOBAL DEBUG validating counter group 0x7f03ec308c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105831208 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105831211 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105831211 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105831211 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105831217 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105831218 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105831218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105831218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:58:32.374069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11585): Terminating (SIGTERM) 10:58:32.414513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11588): Terminating (SIGTERM) 10:58:32.455191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11591): Terminating (SIGTERM) 10:58:32.496066 --- ParallelTerminationStrategy: PID 11585 died... 10:58:32.515361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11585): Terminated: ok {rc=0} 10:58:32.559607 --- ParallelTerminationStrategy: PID 11588 died... 10:58:32.578400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11588): Terminated: ok {rc=0} 10:58:32.622424 --- ParallelTerminationStrategy: PID 11591 died... 10:58:32.641142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11591): Terminated: ok {rc=0} 10:58:32.726797 bus /sierra_3: Setting Powered False 10:58:33.827087 bus /sierra_3: Setting Powered False 10:58:34.942758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 10:58:36.171424 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:58:36.175690 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:58:36.205309 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 10:58:36.212403 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 10:58:36.250437 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:58:36.280337 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 10:58:36.287259 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 10:58:36.806628 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2388 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 10:58:36.811663 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 10:58:36.822983 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:58:36.871160 tst assert_extension.py: using LAC 33473 10:58:36.994861 tst assert_extension.py: using RAC 68 10:58:37.117555 tst assert_extension.py: using CellId 33473 10:58:37.235044 tst assert_extension.py: using BVCI 33474 10:58:37.342437 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 10:58:37.461422 tst assert_extension.py:10: start nitb and bts... 10:58:37.676508 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:58:38.326970 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11597): Launched 10:58:38.648817 run osmo-nitb_10.42.42.2(pid=11598): Launched 10:58:38.827080 run osmo-nitb_10.42.42.2(pid=11598): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11598)] 10:58:38.970153 run osmo-nitb_10.42.42.2(pid=11598): stdout: | (launched: 2022-12-13_10:58:38.590280) 10:58:39.114925 run osmo-nitb_10.42.42.2(pid=11598): stderr: | (launched: 2022-12-13_10:58:38.637895) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:58:39.259541 run osmo-nitb_10.42.42.2(pid=11598): stdout: | (launched: 2022-12-13_10:58:38.590280) 10:58:39.398689 run osmo-nitb_10.42.42.2(pid=11598): stderr: | (launched: 2022-12-13_10:58:38.637895) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11598): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11598) [trial-2388↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11598)] 10:58:39.770728 tst osmo-nitb_10.42.42.2(pid=11598): stdout: | (launched: 2022-12-13_10:58:38.590280) 10:58:39.900007 tst osmo-nitb_10.42.42.2(pid=11598): stderr: | (launched: 2022-12-13_10:58:38.637895) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:58:40.052350 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=11598): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11598) [trial-2388↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11598)] [trial-2388↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 10:58:40.061859 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:58:40.069184 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11597): Terminating (SIGTERM) 10:58:40.280360 --- ParallelTerminationStrategy: PID 11597 died... 10:58:40.301860 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11597): Terminated: ok {rc=0} 10:58:40.391412 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 10:58:41.568517 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:58:41.572784 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:58:41.602530 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 10:58:41.631709 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 10:58:41.666822 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:58:41.695729 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 10:58:41.721995 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 10:58:42.253815 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2388 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 10:58:42.258850 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:58:42.269829 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:58:42.312729 tst assert_extension.py: using LAC 33474 10:58:42.441045 tst assert_extension.py: using RAC 69 10:58:42.564867 tst assert_extension.py: using CellId 33474 10:58:42.687778 tst assert_extension.py: using BVCI 33475 10:58:42.802641 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:58:42.813874 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:58:42.824939 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:58:42.836017 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:58:42.846987 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:58:42.858294 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 10:58:42.978240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:43.473472 run create_hlr_db(pid=11602): Launched 10:58:43.594054 bus /sierra_2: Setting Powered False 10:58:44.657764 run create_hlr_db(pid=11602): Terminated: ok {rc=0} 10:58:45.084585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11604): Launched 10:58:45.383155 run osmo-hlr_10.42.42.2(pid=11605): Launched 10:58:45.496554 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:46.049795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11607): Launched 10:58:46.381714 run osmo-stp_10.42.42.5(pid=11608): Launched 10:58:46.635456 run osmo-msc_10.42.42.6: Starting osmo-msc 10:58:47.287395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11610): Launched 10:58:47.584539 run osmo-msc_10.42.42.6(pid=11611): Launched 10:58:47.751532 run osmo-stp_10.42.42.5(pid=11608): ERR: Terminated: ERROR {rc=1} [trial-2388↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11608)] 10:58:47.876099 run osmo-stp_10.42.42.5(pid=11608): stdout: | (launched: 2022-12-13_10:58:46.317626) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:48.001147 run osmo-stp_10.42.42.5(pid=11608): stderr: | 20221213105846583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105846583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105846583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105846584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105846584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105846584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105846584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:48.124777 run osmo-stp_10.42.42.5(pid=11608): stdout: | (launched: 2022-12-13_10:58:46.317626) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:48.243152 run osmo-stp_10.42.42.5(pid=11608): stderr: | 20221213105846583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105846583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105846583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105846584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105846584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105846584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105846584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:48.384596 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=11608): Process ended prematurely: osmo-stp_10.42.42.5(pid=11608) [trial-2388↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11608)] [trial-2388↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 10:58:48.393133 tst assert_extension.py:17: Test FAILED (6.1 sec) 10:58:48.419139 run osmo-hlr_10.42.42.2(pid=11605): ERR: Terminated: ERROR {rc=237} [trial-2388↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11605)] 10:58:48.466629 run osmo-hlr_10.42.42.2(pid=11605): stdout: | (launched: 2022-12-13_10:58:45.327994) 10:58:48.516106 run osmo-hlr_10.42.42.2(pid=11605): stderr: | 20221213105845507 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105845507 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105845507 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105845507 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105845507 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105845507 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105845519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105845530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105845530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105845530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:48.585344 run osmo-msc_10.42.42.6(pid=11611): ERR: Terminated: ERROR {rc=2} [trial-2388↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11611)] 10:58:48.632818 run osmo-msc_10.42.42.6(pid=11611): stdout: | (launched: 2022-12-13_10:58:47.529675) 10:58:48.682525 run osmo-msc_10.42.42.6(pid=11611): stderr: | 20221213105847800 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105847800 DLGLOBAL DEBUG validating counter group 0x7f72ae18bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105847800 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105847800 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105847800 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105847800 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105847802 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105847802 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105847803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105847803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:58:48.732006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11604): Terminating (SIGTERM) 10:58:48.771700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11607): Terminating (SIGTERM) 10:58:48.811535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11610): Terminating (SIGTERM) 10:58:48.851539 --- ParallelTerminationStrategy: PID 11604 died... 10:58:48.870907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11604): Terminated: ok {rc=0} 10:58:48.915036 --- ParallelTerminationStrategy: PID 11607 died... 10:58:48.933864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11607): Terminated: ok {rc=0} 10:58:48.977814 --- ParallelTerminationStrategy: PID 11610 died... 10:58:48.996714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11610): Terminated: ok {rc=0} 10:58:49.082096 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:58:50.285962 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:58:50.292121 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:58:50.320581 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:58:50.348396 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:58:50.400135 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:58:50.428657 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:58:50.455198 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:58:51.007146 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:58:51.057040 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:58:51.068741 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:58:51.138619 tst mo_mt_call.py: using LAC 33475 10:58:51.258196 tst mo_mt_call.py: using RAC 70 10:58:51.378391 tst mo_mt_call.py: using CellId 33475 10:58:51.497629 tst mo_mt_call.py: using BVCI 33476 10:58:51.608009 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:58:51.619266 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:58:51.630365 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:58:51.641463 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:58:51.652484 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:58:51.663922 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:58:51.780530 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:58:51.900656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:52.406166 run create_hlr_db(pid=11616): Launched 10:58:52.531777 bus /sierra_2: Setting Powered False 10:58:53.596435 run create_hlr_db(pid=11616): Terminated: ok {rc=0} 10:58:54.031711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11618): Launched 10:58:54.336060 run osmo-hlr_10.42.42.2(pid=11619): Launched 10:58:54.452583 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:54.991481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11621): Launched 10:58:55.295426 run osmo-stp_10.42.42.5(pid=11622): Launched 10:58:55.411555 run osmo-msc_10.42.42.6: Starting osmo-msc 10:58:55.962300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11624): Launched 10:58:56.266032 run osmo-msc_10.42.42.6(pid=11625): Launched 10:58:56.437631 run osmo-stp_10.42.42.5(pid=11622): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11622)] 10:58:56.565815 run osmo-stp_10.42.42.5(pid=11622): stdout: | (launched: 2022-12-13_10:58:55.238712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:56.693710 run osmo-stp_10.42.42.5(pid=11622): stderr: | 20221213105855411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105855412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105855412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105855412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105855413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105855413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105855413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:56.819263 run osmo-stp_10.42.42.5(pid=11622): stdout: | (launched: 2022-12-13_10:58:55.238712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:56.939540 run osmo-stp_10.42.42.5(pid=11622): stderr: | 20221213105855411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105855412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105855412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105855412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105855413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105855413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105855413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:57.083239 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11622): Process ended prematurely: osmo-stp_10.42.42.5(pid=11622) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11622)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:58:57.092102 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:58:57.118672 run osmo-hlr_10.42.42.2(pid=11619): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11619)] 10:58:57.166823 run osmo-hlr_10.42.42.2(pid=11619): stdout: | (launched: 2022-12-13_10:58:54.280164) 10:58:57.215681 run osmo-hlr_10.42.42.2(pid=11619): stderr: | 20221213105854460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105854460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105854460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105854460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105854460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105854460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105854473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105854483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105854483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105854484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:57.284397 run osmo-msc_10.42.42.6(pid=11625): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11625)] 10:58:57.331731 run osmo-msc_10.42.42.6(pid=11625): stdout: | (launched: 2022-12-13_10:58:56.209922) 10:58:57.380666 run osmo-msc_10.42.42.6(pid=11625): stderr: | 20221213105856480 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105856480 DLGLOBAL DEBUG validating counter group 0x7fc814d5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105856480 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105856480 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105856480 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105856481 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105856482 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105856483 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105856483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105856483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:58:57.429929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11618): Terminating (SIGTERM) 10:58:57.469179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11621): Terminating (SIGTERM) 10:58:57.508633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11624): Terminating (SIGTERM) 10:58:57.548464 --- ParallelTerminationStrategy: PID 11618 died... 10:58:57.567439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11618): Terminated: ok {rc=0} 10:58:57.611356 --- ParallelTerminationStrategy: PID 11621 died... 10:58:57.630025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11621): Terminated: ok {rc=0} 10:58:57.673559 --- ParallelTerminationStrategy: PID 11624 died... 10:58:57.692155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11624): Terminated: ok {rc=0} 10:58:57.775538 bus /sierra_3: Setting Powered False 10:58:58.873254 bus /sierra_3: Setting Powered False 10:58:59.990572 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:59:01.140468 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:59:01.154063 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:59:01.223975 tst mo_mt_call_osmux.py: using LAC 33476 10:59:01.345251 tst mo_mt_call_osmux.py: using RAC 71 10:59:01.477313 tst mo_mt_call_osmux.py: using CellId 33476 10:59:01.609825 tst mo_mt_call_osmux.py: using BVCI 33477 10:59:01.722906 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:59:01.735385 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:59:01.747906 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:59:01.760340 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:59:01.772814 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:59:01.784791 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:59:01.901397 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:59:02.046816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:02.565689 run create_hlr_db(pid=11627): Launched 10:59:02.691837 bus /sierra_2: Setting Powered False 10:59:03.757287 run create_hlr_db(pid=11627): Terminated: ok {rc=0} 10:59:04.192362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11629): Launched 10:59:04.496848 run osmo-hlr_10.42.42.2(pid=11630): Launched 10:59:04.613848 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:05.137118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11632): Launched 10:59:05.439930 run osmo-stp_10.42.42.5(pid=11633): Launched 10:59:05.555927 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:06.109359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11635): Launched 10:59:06.413595 run osmo-msc_10.42.42.6(pid=11636): Launched 10:59:06.583845 run osmo-stp_10.42.42.5(pid=11633): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11633)] 10:59:06.711990 run osmo-stp_10.42.42.5(pid=11633): stdout: | (launched: 2022-12-13_10:59:05.384042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:06.839680 run osmo-stp_10.42.42.5(pid=11633): stderr: | 20221213105905556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105905556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105905556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105905557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105905557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105905557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105905557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:06.965666 run osmo-stp_10.42.42.5(pid=11633): stdout: | (launched: 2022-12-13_10:59:05.384042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:07.085937 run osmo-stp_10.42.42.5(pid=11633): stderr: | 20221213105905556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105905556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105905556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105905557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105905557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105905557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105905557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:07.230082 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11633): Process ended prematurely: osmo-stp_10.42.42.5(pid=11633) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11633)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:59:07.238905 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:59:07.265577 run osmo-hlr_10.42.42.2(pid=11630): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11630)] 10:59:07.313419 run osmo-hlr_10.42.42.2(pid=11630): stdout: | (launched: 2022-12-13_10:59:04.440575) 10:59:07.362660 run osmo-hlr_10.42.42.2(pid=11630): stderr: | 20221213105904620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105904620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105904620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105904620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105904620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105904620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105904632 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105904641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105904641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105904641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:07.431828 run osmo-msc_10.42.42.6(pid=11636): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11636)] 10:59:07.479673 run osmo-msc_10.42.42.6(pid=11636): stdout: | (launched: 2022-12-13_10:59:06.357505) 10:59:07.529450 run osmo-msc_10.42.42.6(pid=11636): stderr: | 20221213105906630 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105906630 DLGLOBAL DEBUG validating counter group 0x7f592d8c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105906630 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105906631 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105906631 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105906631 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105906633 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105906633 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105906633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105906633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:07.579223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11629): Terminating (SIGTERM) 10:59:07.619531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11632): Terminating (SIGTERM) 10:59:07.659459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11635): Terminating (SIGTERM) 10:59:07.699517 --- ParallelTerminationStrategy: PID 11629 died... 10:59:07.718934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11629): Terminated: ok {rc=0} 10:59:07.763089 --- ParallelTerminationStrategy: PID 11632 died... 10:59:07.781948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11632): Terminated: ok {rc=0} 10:59:07.826267 --- ParallelTerminationStrategy: PID 11635 died... 10:59:07.845103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11635): Terminated: ok {rc=0} 10:59:07.929867 bus /sierra_3: Setting Powered False 10:59:09.028271 bus /sierra_3: Setting Powered False 10:59:10.142764 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:59:11.389934 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:59:11.396918 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:59:11.426346 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:59:11.454676 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:59:11.509067 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:59:11.539116 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:59:11.566579 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:59:12.117291 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:59:12.171341 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:59:12.183173 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:59:12.250706 tst mo_mt_call.py: using LAC 33477 10:59:12.378403 tst mo_mt_call.py: using RAC 72 10:59:12.505739 tst mo_mt_call.py: using CellId 33477 10:59:12.625517 tst mo_mt_call.py: using BVCI 33478 10:59:12.734954 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:59:12.746280 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:59:12.757475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:59:12.768530 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:59:12.779713 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:59:12.790646 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:59:12.911090 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:59:13.028328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:13.499085 run create_hlr_db(pid=11643): Launched 10:59:13.622656 bus /sierra_2: Setting Powered False 10:59:14.683209 run create_hlr_db(pid=11643): Terminated: ok {rc=0} 10:59:15.126213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11645): Launched 10:59:15.452033 run osmo-hlr_10.42.42.2(pid=11646): Launched 10:59:15.577740 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:16.148281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11648): Launched 10:59:16.476406 run osmo-stp_10.42.42.5(pid=11649): Launched 10:59:16.799347 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:17.377708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11651): Launched 10:59:17.685242 run osmo-msc_10.42.42.6(pid=11652): Launched 10:59:17.854487 run osmo-stp_10.42.42.5(pid=11649): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11649)] 10:59:17.983261 run osmo-stp_10.42.42.5(pid=11649): stdout: | (launched: 2022-12-13_10:59:16.415246) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:18.110859 run osmo-stp_10.42.42.5(pid=11649): stderr: | 20221213105916635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105916636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105916636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105916636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105916639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105916639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105916639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:18.236890 run osmo-stp_10.42.42.5(pid=11649): stdout: | (launched: 2022-12-13_10:59:16.415246) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:18.357439 run osmo-stp_10.42.42.5(pid=11649): stderr: | 20221213105916635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105916636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105916636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105916636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105916639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105916639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105916639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:18.501789 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11649): Process ended prematurely: osmo-stp_10.42.42.5(pid=11649) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11649)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:59:18.510648 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:59:18.536780 run osmo-hlr_10.42.42.2(pid=11646): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11646)] 10:59:18.583866 run osmo-hlr_10.42.42.2(pid=11646): stdout: | (launched: 2022-12-13_10:59:15.392603) 10:59:18.632754 run osmo-hlr_10.42.42.2(pid=11646): stderr: | 20221213105915590 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105915590 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105915590 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105915590 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105915590 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105915590 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105915604 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105915614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105915614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105915614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:18.701490 run osmo-msc_10.42.42.6(pid=11652): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11652)] 10:59:18.748533 run osmo-msc_10.42.42.6(pid=11652): stdout: | (launched: 2022-12-13_10:59:17.628739) 10:59:18.797472 run osmo-msc_10.42.42.6(pid=11652): stderr: | 20221213105917900 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105917901 DLGLOBAL DEBUG validating counter group 0x7fdc1840dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105917901 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105917901 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105917901 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105917901 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105917903 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105917903 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105917903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105917904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:18.846646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11645): Terminating (SIGTERM) 10:59:18.885902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11648): Terminating (SIGTERM) 10:59:18.925282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11651): Terminating (SIGTERM) 10:59:18.965477 --- ParallelTerminationStrategy: PID 11645 died... 10:59:18.984608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11645): Terminated: ok {rc=0} 10:59:19.028280 --- ParallelTerminationStrategy: PID 11648 died... 10:59:19.046967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11648): Terminated: ok {rc=0} 10:59:19.090660 --- ParallelTerminationStrategy: PID 11651 died... 10:59:19.109224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11651): Terminated: ok {rc=0} 10:59:19.194679 bus /sierra_3: Setting Powered False 10:59:20.293661 bus /sierra_3: Setting Powered False 10:59:21.407711 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:59:22.558731 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:59:22.571129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:59:22.638610 tst mo_mt_call_osmux.py: using LAC 33478 10:59:22.767455 tst mo_mt_call_osmux.py: using RAC 73 10:59:22.894420 tst mo_mt_call_osmux.py: using CellId 33478 10:59:23.021652 tst mo_mt_call_osmux.py: using BVCI 33479 10:59:23.134454 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:59:23.145912 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:59:23.157164 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:59:23.168366 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:59:23.179562 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:59:23.191429 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:59:23.309174 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:59:23.431251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:23.903539 run create_hlr_db(pid=11654): Launched 10:59:24.028793 bus /sierra_2: Setting Powered False 10:59:25.089991 run create_hlr_db(pid=11654): Terminated: ok {rc=0} 10:59:25.513694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11656): Launched 10:59:25.817091 run osmo-hlr_10.42.42.2(pid=11657): Launched 10:59:25.932678 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:26.470828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11659): Launched 10:59:26.774729 run osmo-stp_10.42.42.5(pid=11660): Launched 10:59:26.889712 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:27.439378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11662): Launched 10:59:27.742330 run osmo-msc_10.42.42.6(pid=11663): Launched 10:59:27.912790 run osmo-stp_10.42.42.5(pid=11660): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11660)] 10:59:28.041775 run osmo-stp_10.42.42.5(pid=11660): stdout: | (launched: 2022-12-13_10:59:26.718673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:28.170183 run osmo-stp_10.42.42.5(pid=11660): stderr: | 20221213105926891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105926891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105926891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105926892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105926894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105926894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105926894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:28.296335 run osmo-stp_10.42.42.5(pid=11660): stdout: | (launched: 2022-12-13_10:59:26.718673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:28.417286 run osmo-stp_10.42.42.5(pid=11660): stderr: | 20221213105926891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105926891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105926891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105926892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105926894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105926894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105926894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:28.562366 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11660): Process ended prematurely: osmo-stp_10.42.42.5(pid=11660) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11660)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:59:28.571422 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:59:28.598108 run osmo-hlr_10.42.42.2(pid=11657): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11657)] 10:59:28.645819 run osmo-hlr_10.42.42.2(pid=11657): stdout: | (launched: 2022-12-13_10:59:25.760925) 10:59:28.694911 run osmo-hlr_10.42.42.2(pid=11657): stderr: | 20221213105925938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105925938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105925938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105925938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105925938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105925938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105925950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105925961 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105925961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105925961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:28.763782 run osmo-msc_10.42.42.6(pid=11663): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11663)] 10:59:28.811727 run osmo-msc_10.42.42.6(pid=11663): stdout: | (launched: 2022-12-13_10:59:27.686563) 10:59:28.860853 run osmo-msc_10.42.42.6(pid=11663): stderr: | 20221213105927957 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105927957 DLGLOBAL DEBUG validating counter group 0x7f35dfc6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105927958 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105927958 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105927958 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105927958 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105927960 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105927960 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105927960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105927960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:28.910402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11656): Terminating (SIGTERM) 10:59:28.949764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11659): Terminating (SIGTERM) 10:59:28.989342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11662): Terminating (SIGTERM) 10:59:29.029753 --- ParallelTerminationStrategy: PID 11656 died... 10:59:29.048872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11656): Terminated: ok {rc=0} 10:59:29.092658 --- ParallelTerminationStrategy: PID 11659 died... 10:59:29.111408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11659): Terminated: ok {rc=0} 10:59:29.154942 --- ParallelTerminationStrategy: PID 11662 died... 10:59:29.173649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11662): Terminated: ok {rc=0} 10:59:29.259337 bus /sierra_3: Setting Powered False 10:59:30.357825 bus /sierra_3: Setting Powered False 10:59:31.471569 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:59:32.733337 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:59:32.739613 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:59:32.768214 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:59:32.794509 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:59:32.846090 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:59:32.875825 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:59:32.903287 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:59:33.451708 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:59:33.500253 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:59:33.511478 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:59:33.575656 tst mo_mt_call.py: using LAC 33479 10:59:33.694523 tst mo_mt_call.py: using RAC 74 10:59:33.817471 tst mo_mt_call.py: using CellId 33479 10:59:33.945224 tst mo_mt_call.py: using BVCI 33480 10:59:34.063548 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:59:34.075430 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:59:34.087148 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:59:34.099049 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:59:34.110613 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:59:34.122329 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:59:34.242630 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:59:34.359337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:34.829423 run create_hlr_db(pid=11668): Launched 10:59:34.953742 bus /sierra_2: Setting Powered False 10:59:36.014979 run create_hlr_db(pid=11668): Terminated: ok {rc=0} 10:59:36.438221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11670): Launched 10:59:36.743602 run osmo-hlr_10.42.42.2(pid=11671): Launched 10:59:36.858228 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:37.379333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11673): Launched 10:59:37.681771 run osmo-stp_10.42.42.5(pid=11674): Launched 10:59:37.797050 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:38.349337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11676): Launched 10:59:38.652329 run osmo-msc_10.42.42.6(pid=11677): Launched 10:59:38.822383 run osmo-stp_10.42.42.5(pid=11674): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11674)] 10:59:38.951151 run osmo-stp_10.42.42.5(pid=11674): stdout: | (launched: 2022-12-13_10:59:37.625724) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:39.079253 run osmo-stp_10.42.42.5(pid=11674): stderr: | 20221213105937798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105937798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105937798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105937798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105937799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105937799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105937799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:39.205500 run osmo-stp_10.42.42.5(pid=11674): stdout: | (launched: 2022-12-13_10:59:37.625724) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:39.326194 run osmo-stp_10.42.42.5(pid=11674): stderr: | 20221213105937798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105937798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105937798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105937798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105937799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105937799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105937799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:39.472568 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11674): Process ended prematurely: osmo-stp_10.42.42.5(pid=11674) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11674)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:59:39.481602 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:59:39.508004 run osmo-hlr_10.42.42.2(pid=11671): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11671)] 10:59:39.555345 run osmo-hlr_10.42.42.2(pid=11671): stdout: | (launched: 2022-12-13_10:59:36.687435) 10:59:39.604461 run osmo-hlr_10.42.42.2(pid=11671): stderr: | 20221213105936863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105936863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105936863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105936863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105936864 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105936864 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105936875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105936884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105936885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105936885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:39.673095 run osmo-msc_10.42.42.6(pid=11677): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11677)] 10:59:39.720362 run osmo-msc_10.42.42.6(pid=11677): stdout: | (launched: 2022-12-13_10:59:38.596164) 10:59:39.769445 run osmo-msc_10.42.42.6(pid=11677): stderr: | 20221213105938867 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105938867 DLGLOBAL DEBUG validating counter group 0x7fc42cd90c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105938867 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105938867 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105938867 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105938868 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105938869 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105938870 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105938870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105938870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:39.818625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11670): Terminating (SIGTERM) 10:59:39.857925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11673): Terminating (SIGTERM) 10:59:39.897029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11676): Terminating (SIGTERM) 10:59:39.936424 --- ParallelTerminationStrategy: PID 11670 died... 10:59:39.955626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11670): Terminated: ok {rc=0} 10:59:39.999255 --- ParallelTerminationStrategy: PID 11673 died... 10:59:40.017940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11673): Terminated: ok {rc=0} 10:59:40.061866 --- ParallelTerminationStrategy: PID 11676 died... 10:59:40.080481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11676): Terminated: ok {rc=0} 10:59:40.163853 bus /sierra_3: Setting Powered False 10:59:41.260826 bus /sierra_3: Setting Powered False 10:59:42.376235 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:59:43.521255 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:59:43.533540 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:59:43.598165 tst mo_mt_call_osmux.py: using LAC 33480 10:59:43.716694 tst mo_mt_call_osmux.py: using RAC 75 10:59:43.835709 tst mo_mt_call_osmux.py: using CellId 33480 10:59:43.965553 tst mo_mt_call_osmux.py: using BVCI 33481 10:59:44.078142 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:59:44.089480 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:59:44.100458 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:59:44.111494 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:59:44.122690 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:59:44.133709 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:59:44.255370 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:59:44.377615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:44.885152 run create_hlr_db(pid=11679): Launched 10:59:45.011295 bus /sierra_2: Setting Powered False 10:59:46.075054 run create_hlr_db(pid=11679): Terminated: ok {rc=0} 10:59:46.537368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11681): Launched 10:59:46.879563 run osmo-hlr_10.42.42.2(pid=11682): Launched 10:59:47.129092 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:47.709765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11684): Launched 10:59:48.035675 run osmo-stp_10.42.42.5(pid=11685): Launched 10:59:48.160666 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:48.752194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11687): Launched 10:59:49.080007 run osmo-msc_10.42.42.6(pid=11688): Launched 10:59:49.263321 run osmo-stp_10.42.42.5(pid=11685): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11685)] 10:59:49.401799 run osmo-stp_10.42.42.5(pid=11685): stdout: | (launched: 2022-12-13_10:59:47.975807) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:49.541204 run osmo-stp_10.42.42.5(pid=11685): stderr: | 20221213105948167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105948167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105948167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105948168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105948168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105948168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105948168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:49.677750 run osmo-stp_10.42.42.5(pid=11685): stdout: | (launched: 2022-12-13_10:59:47.975807) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:49.808156 run osmo-stp_10.42.42.5(pid=11685): stderr: | 20221213105948167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105948167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105948167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105948168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105948168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105948168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105948168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:49.964196 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11685): Process ended prematurely: osmo-stp_10.42.42.5(pid=11685) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11685)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:59:49.973755 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:59:50.001711 run osmo-hlr_10.42.42.2(pid=11682): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11682)] 10:59:50.052753 run osmo-hlr_10.42.42.2(pid=11682): stdout: | (launched: 2022-12-13_10:59:46.819083) 10:59:50.105164 run osmo-hlr_10.42.42.2(pid=11682): stderr: | 20221213105947018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105947018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105947018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105947018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105947018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105947019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105947030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105947043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105947043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105947043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:50.178463 run osmo-msc_10.42.42.6(pid=11688): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11688)] 10:59:50.228934 run osmo-msc_10.42.42.6(pid=11688): stdout: | (launched: 2022-12-13_10:59:49.019539) 10:59:50.281138 run osmo-msc_10.42.42.6(pid=11688): stderr: | 20221213105949340 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213105949340 DLGLOBAL DEBUG validating counter group 0x7f4e4b18bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213105949340 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213105949340 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213105949341 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213105949341 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213105949343 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213105949343 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213105949343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213105949343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:50.333835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11681): Terminating (SIGTERM) 10:59:50.375990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11684): Terminating (SIGTERM) 10:59:50.418387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11687): Terminating (SIGTERM) 10:59:50.461406 --- ParallelTerminationStrategy: PID 11681 died... 10:59:50.482169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11681): Terminated: ok {rc=0} 10:59:50.528810 --- ParallelTerminationStrategy: PID 11684 died... 10:59:50.549346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11684): Terminated: ok {rc=0} 10:59:50.595962 --- ParallelTerminationStrategy: PID 11687 died... 10:59:50.616129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11687): Terminated: ok {rc=0} 10:59:50.704639 bus /sierra_3: Setting Powered False 10:59:51.804243 bus /sierra_3: Setting Powered False 10:59:52.922452 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:59:54.164574 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:59:54.171454 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:59:54.200163 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:59:54.226411 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:59:54.286169 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:59:54.315249 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:59:54.341386 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:59:54.891441 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:59:54.939794 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:59:54.951158 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:59:55.015947 tst mo_mt_call.py: using LAC 33481 10:59:55.144914 tst mo_mt_call.py: using RAC 76 10:59:55.273885 tst mo_mt_call.py: using CellId 33481 10:59:55.400415 tst mo_mt_call.py: using BVCI 33482 10:59:55.520526 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:59:55.532157 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:59:55.543663 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:59:55.555115 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:59:55.566624 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:59:55.578533 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:59:55.694837 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:59:55.816493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:56.322966 run create_hlr_db(pid=11693): Launched 10:59:56.447435 bus /sierra_2: Setting Powered False 10:59:57.513473 run create_hlr_db(pid=11693): Terminated: ok {rc=0} 10:59:57.949491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11695): Launched 10:59:58.255008 run osmo-hlr_10.42.42.2(pid=11696): Launched 10:59:58.371075 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:58.893655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11698): Launched 10:59:59.196115 run osmo-stp_10.42.42.5(pid=11699): Launched 10:59:59.311741 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:59.859937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11701): Launched 11:00:00.163884 run osmo-msc_10.42.42.6(pid=11702): Launched 11:00:00.334660 run osmo-stp_10.42.42.5(pid=11699): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11699)] 11:00:00.463239 run osmo-stp_10.42.42.5(pid=11699): stdout: | (launched: 2022-12-13_10:59:59.140113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:00.591332 run osmo-stp_10.42.42.5(pid=11699): stderr: | 20221213105959311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105959311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105959311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105959312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105959312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105959312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105959312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:00.717411 run osmo-stp_10.42.42.5(pid=11699): stdout: | (launched: 2022-12-13_10:59:59.140113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:00.837926 run osmo-stp_10.42.42.5(pid=11699): stderr: | 20221213105959311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213105959311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213105959311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213105959312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213105959312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213105959312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213105959312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:01.026278 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11699): Process ended prematurely: osmo-stp_10.42.42.5(pid=11699) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11699)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:00:01.037666 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:00:01.066844 run osmo-hlr_10.42.42.2(pid=11696): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11696)] 11:00:01.121150 run osmo-hlr_10.42.42.2(pid=11696): stdout: | (launched: 2022-12-13_10:59:58.198301) 11:00:01.176360 run osmo-hlr_10.42.42.2(pid=11696): stderr: | 20221213105958375 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213105958375 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213105958375 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213105958375 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213105958375 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213105958376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213105958388 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213105958397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213105958397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213105958397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:01.254667 run osmo-msc_10.42.42.6(pid=11702): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11702)] 11:00:01.307092 run osmo-msc_10.42.42.6(pid=11702): stdout: | (launched: 2022-12-13_11:00:00.108024) 11:00:01.361836 run osmo-msc_10.42.42.6(pid=11702): stderr: | 20221213110000380 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110000380 DLGLOBAL DEBUG validating counter group 0x7f115805ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110000380 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110000380 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110000380 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110000380 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110000382 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110000383 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110000383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110000383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:00:01.416825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11695): Terminating (SIGTERM) 11:00:01.469637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11698): Terminating (SIGTERM) 11:00:01.519561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11701): Terminating (SIGTERM) 11:00:01.567395 --- ParallelTerminationStrategy: PID 11695 died... 11:00:01.588380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11695): Terminated: ok {rc=0} 11:00:01.641969 --- ParallelTerminationStrategy: PID 11698 died... 11:00:01.664301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11698): Terminated: ok {rc=0} 11:00:01.713313 --- ParallelTerminationStrategy: PID 11701 died... 11:00:01.736050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11701): Terminated: ok {rc=0} 11:00:01.835685 bus /sierra_3: Setting Powered False 11:00:02.955260 bus /sierra_3: Setting Powered False 11:00:04.070869 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:00:05.214013 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:00:05.225772 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:00:05.289803 tst mo_mt_call_osmux.py: using LAC 33482 11:00:05.418632 tst mo_mt_call_osmux.py: using RAC 77 11:00:05.544790 tst mo_mt_call_osmux.py: using CellId 33482 11:00:05.670885 tst mo_mt_call_osmux.py: using BVCI 33483 11:00:05.789201 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:00:05.801247 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:00:05.812642 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:00:05.824076 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:00:05.835878 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:00:05.847637 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:00:05.969505 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:00:06.091741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:06.598565 run create_hlr_db(pid=11707): Launched 11:00:06.723768 bus /sierra_2: Setting Powered False 11:00:07.787888 run create_hlr_db(pid=11707): Terminated: ok {rc=0} 11:00:08.223472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11709): Launched 11:00:08.528151 run osmo-hlr_10.42.42.2(pid=11710): Launched 11:00:08.645070 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:09.167354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11712): Launched 11:00:09.470545 run osmo-stp_10.42.42.5(pid=11713): Launched 11:00:09.586538 run osmo-msc_10.42.42.6: Starting osmo-msc 11:00:10.135781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11715): Launched 11:00:10.440753 run osmo-msc_10.42.42.6(pid=11716): Launched 11:00:10.611814 run osmo-stp_10.42.42.5(pid=11713): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11713)] 11:00:10.740067 run osmo-stp_10.42.42.5(pid=11713): stdout: | (launched: 2022-12-13_11:00:09.414604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:10.867805 run osmo-stp_10.42.42.5(pid=11713): stderr: | 20221213110009586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110009586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110009586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110009587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110009589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110009589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110009589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:10.993896 run osmo-stp_10.42.42.5(pid=11713): stdout: | (launched: 2022-12-13_11:00:09.414604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:11.114446 run osmo-stp_10.42.42.5(pid=11713): stderr: | 20221213110009586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110009586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110009586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110009587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110009589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110009589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110009589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:11.258890 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11713): Process ended prematurely: osmo-stp_10.42.42.5(pid=11713) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11713)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:00:11.267617 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:00:11.294048 run osmo-hlr_10.42.42.2(pid=11710): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11710)] 11:00:11.341971 run osmo-hlr_10.42.42.2(pid=11710): stdout: | (launched: 2022-12-13_11:00:08.472161) 11:00:11.391224 run osmo-hlr_10.42.42.2(pid=11710): stderr: | 20221213110008652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110008652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110008652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110008652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110008652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110008652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110008674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110008683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110008683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110008683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:11.460549 run osmo-msc_10.42.42.6(pid=11716): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11716)] 11:00:11.508050 run osmo-msc_10.42.42.6(pid=11716): stdout: | (launched: 2022-12-13_11:00:10.384450) 11:00:11.557110 run osmo-msc_10.42.42.6(pid=11716): stderr: | 20221213110010655 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110010655 DLGLOBAL DEBUG validating counter group 0x7f10fd005c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110010655 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110010655 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110010655 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110010655 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110010657 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110010657 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110010658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110010658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:00:11.606625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11709): Terminating (SIGTERM) 11:00:11.645986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11712): Terminating (SIGTERM) 11:00:11.685558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11715): Terminating (SIGTERM) 11:00:11.725337 --- ParallelTerminationStrategy: PID 11709 died... 11:00:11.744288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11709): Terminated: ok {rc=0} 11:00:11.788584 --- ParallelTerminationStrategy: PID 11712 died... 11:00:11.807402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11712): Terminated: ok {rc=0} 11:00:11.851259 --- ParallelTerminationStrategy: PID 11715 died... 11:00:11.870076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11715): Terminated: ok {rc=0} 11:00:11.956010 bus /sierra_3: Setting Powered False 11:00:13.056576 bus /sierra_3: Setting Powered False 11:00:14.173512 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:00:15.423287 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:00:15.430566 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:00:15.460301 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:00:15.489106 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:00:15.542164 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:00:15.571783 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:00:15.599606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:00:16.189798 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:00:16.244364 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:16.257218 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:00:16.322966 tst mo_mt_call.py: using LAC 33483 11:00:16.484344 tst mo_mt_call.py: using RAC 78 11:00:16.615186 tst mo_mt_call.py: using CellId 33483 11:00:16.787357 tst mo_mt_call.py: using BVCI 33484 11:00:16.950633 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:16.966827 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:16.978742 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:16.997674 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:17.010669 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:17.024792 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:00:17.147448 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:00:17.278692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:17.787055 run create_hlr_db(pid=11721): Launched 11:00:17.911767 bus /sierra_2: Setting Powered False 11:00:18.975792 run create_hlr_db(pid=11721): Terminated: ok {rc=0} 11:00:19.411573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11723): Launched 11:00:19.717043 run osmo-hlr_10.42.42.2(pid=11724): Launched 11:00:19.832442 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:20.355072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11726): Launched 11:00:20.660051 run osmo-stp_10.42.42.5(pid=11727): Launched 11:00:20.774941 run osmo-msc_10.42.42.6: Starting osmo-msc 11:00:21.324207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11729): Launched 11:00:21.628914 run osmo-msc_10.42.42.6(pid=11730): Launched 11:00:21.798616 run osmo-stp_10.42.42.5(pid=11727): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11727)] 11:00:21.927717 run osmo-stp_10.42.42.5(pid=11727): stdout: | (launched: 2022-12-13_11:00:20.604047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:22.055347 run osmo-stp_10.42.42.5(pid=11727): stderr: | 20221213110020776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110020776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110020777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110020777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110020777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110020778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110020778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:22.181594 run osmo-stp_10.42.42.5(pid=11727): stdout: | (launched: 2022-12-13_11:00:20.604047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:22.302071 run osmo-stp_10.42.42.5(pid=11727): stderr: | 20221213110020776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110020776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110020777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110020777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110020777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110020778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110020778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:22.447196 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11727): Process ended prematurely: osmo-stp_10.42.42.5(pid=11727) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11727)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:00:22.456247 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:00:22.482681 run osmo-hlr_10.42.42.2(pid=11724): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11724)] 11:00:22.530288 run osmo-hlr_10.42.42.2(pid=11724): stdout: | (launched: 2022-12-13_11:00:19.660432) 11:00:22.579384 run osmo-hlr_10.42.42.2(pid=11724): stderr: | 20221213110019839 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110019839 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110019839 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110019839 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110019839 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110019839 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110019851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110019862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110019862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110019862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:22.648080 run osmo-msc_10.42.42.6(pid=11730): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11730)] 11:00:22.695495 run osmo-msc_10.42.42.6(pid=11730): stdout: | (launched: 2022-12-13_11:00:21.572441) 11:00:22.744298 run osmo-msc_10.42.42.6(pid=11730): stderr: | 20221213110021843 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110021843 DLGLOBAL DEBUG validating counter group 0x7f544eeefc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110021843 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110021843 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110021843 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110021843 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110021845 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110021846 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110021846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110021846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:00:22.793384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11723): Terminating (SIGTERM) 11:00:22.832494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11726): Terminating (SIGTERM) 11:00:22.871703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11729): Terminating (SIGTERM) 11:00:22.911318 --- ParallelTerminationStrategy: PID 11723 died... 11:00:22.930674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11723): Terminated: ok {rc=0} 11:00:22.974367 --- ParallelTerminationStrategy: PID 11726 died... 11:00:22.993163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11726): Terminated: ok {rc=0} 11:00:23.036719 --- ParallelTerminationStrategy: PID 11729 died... 11:00:23.055449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11729): Terminated: ok {rc=0} 11:00:23.140380 bus /sierra_3: Setting Powered False 11:00:24.239526 bus /sierra_3: Setting Powered False 11:00:25.352207 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:00:26.501475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:26.514088 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:00:26.583653 tst mo_mt_call_osmux.py: using LAC 33484 11:00:26.711756 tst mo_mt_call_osmux.py: using RAC 79 11:00:26.840033 tst mo_mt_call_osmux.py: using CellId 33484 11:00:26.970946 tst mo_mt_call_osmux.py: using BVCI 33485 11:00:27.090815 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:27.102645 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:27.114226 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:27.125819 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:27.137983 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:27.149974 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:00:27.272509 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:00:27.392638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:27.898265 run create_hlr_db(pid=11732): Launched 11:00:28.023624 bus /sierra_2: Setting Powered False 11:00:29.087916 run create_hlr_db(pid=11732): Terminated: ok {rc=0} 11:00:29.522902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11734): Launched 11:00:29.852398 run osmo-hlr_10.42.42.2(pid=11735): Launched 11:00:29.976817 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:30.540054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11737): Launched 11:00:30.881729 run osmo-stp_10.42.42.5(pid=11738): Launched 11:00:31.165909 run osmo-msc_10.42.42.6: Starting osmo-msc 11:00:31.765875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11740): Launched 11:00:32.094813 run osmo-msc_10.42.42.6(pid=11741): Launched 11:00:32.470203 run osmo-stp_10.42.42.5(pid=11738): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11738)] 11:00:32.608316 run osmo-stp_10.42.42.5(pid=11738): stdout: | (launched: 2022-12-13_11:00:30.809063) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:32.745853 run osmo-stp_10.42.42.5(pid=11738): stderr: | 20221213110031043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110031043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110031043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110031044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110031046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110031046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110031046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:32.882616 run osmo-stp_10.42.42.5(pid=11738): stdout: | (launched: 2022-12-13_11:00:30.809063) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:33.013408 run osmo-stp_10.42.42.5(pid=11738): stderr: | 20221213110031043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110031043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110031043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110031044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110031046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110031046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110031046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:33.169805 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11738): Process ended prematurely: osmo-stp_10.42.42.5(pid=11738) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11738)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:00:33.179647 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 11:00:33.207866 run osmo-hlr_10.42.42.2(pid=11735): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11735)] 11:00:33.259534 run osmo-hlr_10.42.42.2(pid=11735): stdout: | (launched: 2022-12-13_11:00:29.792848) 11:00:33.311553 run osmo-hlr_10.42.42.2(pid=11735): stderr: | 20221213110029992 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110029992 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110029992 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110029992 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110029992 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110029992 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110030007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110030017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110030018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110030018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:33.384453 run osmo-msc_10.42.42.6(pid=11741): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11741)] 11:00:33.434482 run osmo-msc_10.42.42.6(pid=11741): stdout: | (launched: 2022-12-13_11:00:32.035579) 11:00:33.486394 run osmo-msc_10.42.42.6(pid=11741): stderr: | 20221213110032351 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110032351 DLGLOBAL DEBUG validating counter group 0x7f99a3dd9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110032351 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110032351 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110032351 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110032351 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110032353 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110032354 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110032354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110032354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:00:33.539882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11734): Terminating (SIGTERM) 11:00:33.582409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11737): Terminating (SIGTERM) 11:00:33.624723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11740): Terminating (SIGTERM) 11:00:33.667652 --- ParallelTerminationStrategy: PID 11734 died... 11:00:33.688299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11734): Terminated: ok {rc=0} 11:00:33.734986 --- ParallelTerminationStrategy: PID 11737 died... 11:00:33.755267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11737): Terminated: ok {rc=0} 11:00:33.801814 --- ParallelTerminationStrategy: PID 11740 died... 11:00:33.821907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11740): Terminated: ok {rc=0} 11:00:33.910593 bus /sierra_3: Setting Powered False 11:00:35.009409 bus /sierra_3: Setting Powered False 11:00:36.124110 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:00:37.373571 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:00:37.382587 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:00:37.412554 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:00:37.440544 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:00:37.492203 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:00:37.522266 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:00:37.550252 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:00:38.103586 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:00:38.157236 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:00:38.169065 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:00:38.236462 tst mo_mt_call.py: using LAC 33485 11:00:38.362410 tst mo_mt_call.py: using RAC 80 11:00:38.488163 tst mo_mt_call.py: using CellId 33485 11:00:38.609937 tst mo_mt_call.py: using BVCI 33486 11:00:38.720916 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:00:38.732602 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:00:38.743924 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:00:38.754930 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:00:38.766548 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:00:38.778132 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:00:38.900684 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:00:39.022677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:39.530247 run create_hlr_db(pid=11747): Launched 11:00:39.656009 bus /sierra_2: Setting Powered False 11:00:40.719923 run create_hlr_db(pid=11747): Terminated: ok {rc=0} 11:00:41.155756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11749): Launched 11:00:41.462079 run osmo-hlr_10.42.42.2(pid=11750): Launched 11:00:41.579388 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:42.104827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11752): Launched 11:00:42.409661 run osmo-stp_10.42.42.5(pid=11753): Launched 11:00:42.526283 run osmo-msc_10.42.42.6: Starting osmo-msc 11:00:43.078069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11755): Launched 11:00:43.382605 run osmo-msc_10.42.42.6(pid=11756): Launched 11:00:43.554944 run osmo-stp_10.42.42.5(pid=11753): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11753)] 11:00:43.683707 run osmo-stp_10.42.42.5(pid=11753): stdout: | (launched: 2022-12-13_11:00:42.353410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:43.811287 run osmo-stp_10.42.42.5(pid=11753): stderr: | 20221213110042524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110042524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110042524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110042525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110042525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110042525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110042525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:43.937515 run osmo-stp_10.42.42.5(pid=11753): stdout: | (launched: 2022-12-13_11:00:42.353410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:44.058511 run osmo-stp_10.42.42.5(pid=11753): stderr: | 20221213110042524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110042524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110042524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110042525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110042525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110042525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110042525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:44.203665 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11753): Process ended prematurely: osmo-stp_10.42.42.5(pid=11753) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11753)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:00:44.212454 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:00:44.238984 run osmo-hlr_10.42.42.2(pid=11750): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11750)] 11:00:44.287166 run osmo-hlr_10.42.42.2(pid=11750): stdout: | (launched: 2022-12-13_11:00:41.405168) 11:00:44.336183 run osmo-hlr_10.42.42.2(pid=11750): stderr: | 20221213110041581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110041581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110041581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110041581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110041581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110041581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110041593 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110041601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110041602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110041602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:44.405118 run osmo-msc_10.42.42.6(pid=11756): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11756)] 11:00:44.452856 run osmo-msc_10.42.42.6(pid=11756): stdout: | (launched: 2022-12-13_11:00:43.326073) 11:00:44.501996 run osmo-msc_10.42.42.6(pid=11756): stderr: | 20221213110043596 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110043596 DLGLOBAL DEBUG validating counter group 0x7f4563449c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110043596 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110043596 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110043597 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110043597 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110043598 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110043599 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110043599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110043599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:00:44.551424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11749): Terminating (SIGTERM) 11:00:44.591565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11752): Terminating (SIGTERM) 11:00:44.631258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11755): Terminating (SIGTERM) 11:00:44.671279 --- ParallelTerminationStrategy: PID 11749 died... 11:00:44.690650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11749): Terminated: ok {rc=0} 11:00:44.734787 --- ParallelTerminationStrategy: PID 11752 died... 11:00:44.753577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11752): Terminated: ok {rc=0} 11:00:44.797470 --- ParallelTerminationStrategy: PID 11755 died... 11:00:44.816339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11755): Terminated: ok {rc=0} 11:00:44.900420 bus /sierra_3: Setting Powered False 11:00:46.009126 bus /sierra_3: Setting Powered False 11:00:47.130042 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:00:48.282915 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:00:48.295262 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:00:48.362739 tst mo_mt_call_osmux.py: using LAC 33486 11:00:48.490772 tst mo_mt_call_osmux.py: using RAC 81 11:00:48.620878 tst mo_mt_call_osmux.py: using CellId 33486 11:00:48.750159 tst mo_mt_call_osmux.py: using BVCI 33487 11:00:48.868639 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:00:48.880585 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:00:48.892237 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:00:48.903912 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:00:48.915830 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:00:48.927738 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:00:49.044536 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:00:49.164811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:49.672745 run create_hlr_db(pid=11758): Launched 11:00:49.797200 bus /sierra_2: Setting Powered False 11:00:50.861790 run create_hlr_db(pid=11758): Terminated: ok {rc=0} 11:00:51.316304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11760): Launched 11:00:51.644583 run osmo-hlr_10.42.42.2(pid=11761): Launched 11:00:51.769632 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:52.337305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11763): Launched 11:00:52.666628 run osmo-stp_10.42.42.5(pid=11764): Launched 11:00:52.794145 run osmo-msc_10.42.42.6: Starting osmo-msc 11:00:53.385041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11766): Launched 11:00:53.712774 run osmo-msc_10.42.42.6(pid=11767): Launched 11:00:53.895560 run osmo-stp_10.42.42.5(pid=11764): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11764)] 11:00:54.033529 run osmo-stp_10.42.42.5(pid=11764): stdout: | (launched: 2022-12-13_11:00:52.606207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:54.171553 run osmo-stp_10.42.42.5(pid=11764): stderr: | 20221213110052801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110052801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110052801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110052801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110052802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110052802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110052802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:54.308885 run osmo-stp_10.42.42.5(pid=11764): stdout: | (launched: 2022-12-13_11:00:52.606207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:54.438876 run osmo-stp_10.42.42.5(pid=11764): stderr: | 20221213110052801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110052801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110052801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110052801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110052802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110052802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110052802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:54.594713 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11764): Process ended prematurely: osmo-stp_10.42.42.5(pid=11764) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11764)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:00:54.604212 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:00:54.632046 run osmo-hlr_10.42.42.2(pid=11761): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11761)] 11:00:54.682912 run osmo-hlr_10.42.42.2(pid=11761): stdout: | (launched: 2022-12-13_11:00:51.584617) 11:00:54.734908 run osmo-hlr_10.42.42.2(pid=11761): stderr: | 20221213110051786 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110051786 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110051786 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110051786 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110051786 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110051786 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110051798 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110051809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110051809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110051809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:54.807907 run osmo-msc_10.42.42.6(pid=11767): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11767)] 11:00:54.857941 run osmo-msc_10.42.42.6(pid=11767): stdout: | (launched: 2022-12-13_11:00:53.652696) 11:00:54.910224 run osmo-msc_10.42.42.6(pid=11767): stderr: | 20221213110053973 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110053974 DLGLOBAL DEBUG validating counter group 0x7fabe2fcec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110053974 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110053974 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110053974 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110053974 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110053976 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110053976 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110053976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110053976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:00:54.962415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11760): Terminating (SIGTERM) 11:00:55.004301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11763): Terminating (SIGTERM) 11:00:55.046348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11766): Terminating (SIGTERM) 11:00:55.089234 --- ParallelTerminationStrategy: PID 11760 died... 11:00:55.109804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11760): Terminated: ok {rc=0} 11:00:55.156385 --- ParallelTerminationStrategy: PID 11763 died... 11:00:55.176506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11763): Terminated: ok {rc=0} 11:00:55.223055 --- ParallelTerminationStrategy: PID 11766 died... 11:00:55.243055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11766): Terminated: ok {rc=0} 11:00:55.331468 bus /sierra_3: Setting Powered False 11:00:56.430545 bus /sierra_3: Setting Powered False 11:00:57.546519 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:00:58.801947 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:00:58.808410 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:00:58.837734 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:00:58.865939 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:00:58.919009 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:00:58.947872 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:00:58.974984 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:00:59.526915 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:00:59.577553 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:00:59.588618 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:00:59.655678 tst mo_mt_call.py: using LAC 33487 11:00:59.776545 tst mo_mt_call.py: using RAC 82 11:00:59.895871 tst mo_mt_call.py: using CellId 33487 11:01:00.017041 tst mo_mt_call.py: using BVCI 33488 11:01:00.126986 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:01:00.138424 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:01:00.149244 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:01:00.160021 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:01:00.171397 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:01:00.182828 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:01:00.304711 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:01:00.421541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:00.921783 run create_hlr_db(pid=11773): Launched 11:01:01.097602 bus /sierra_2: Setting Powered False 11:01:02.166620 run create_hlr_db(pid=11773): Terminated: ok {rc=0} 11:01:02.626663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11775): Launched 11:01:02.934548 run osmo-hlr_10.42.42.2(pid=11776): Launched 11:01:03.051492 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:03.590806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11778): Launched 11:01:03.895227 run osmo-stp_10.42.42.5(pid=11779): Launched 11:01:04.011176 run osmo-msc_10.42.42.6: Starting osmo-msc 11:01:04.562569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11781): Launched 11:01:04.870311 run osmo-msc_10.42.42.6(pid=11782): Launched 11:01:05.040819 run osmo-stp_10.42.42.5(pid=11779): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11779)] 11:01:05.170187 run osmo-stp_10.42.42.5(pid=11779): stdout: | (launched: 2022-12-13_11:01:03.838698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:05.298644 run osmo-stp_10.42.42.5(pid=11779): stderr: | 20221213110104010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110104010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110104010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110104010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110104011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110104011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110104011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:05.425240 run osmo-stp_10.42.42.5(pid=11779): stdout: | (launched: 2022-12-13_11:01:03.838698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:05.546121 run osmo-stp_10.42.42.5(pid=11779): stderr: | 20221213110104010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110104010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110104010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110104010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110104011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110104011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110104011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:05.691135 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11779): Process ended prematurely: osmo-stp_10.42.42.5(pid=11779) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11779)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:01:05.699896 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:01:05.726379 run osmo-hlr_10.42.42.2(pid=11776): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11776)] 11:01:05.773692 run osmo-hlr_10.42.42.2(pid=11776): stdout: | (launched: 2022-12-13_11:01:02.878321) 11:01:05.822890 run osmo-hlr_10.42.42.2(pid=11776): stderr: | 20221213110103057 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110103057 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110103057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110103057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110103057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110103057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110103069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110103079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110103079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110103079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:05.891715 run osmo-msc_10.42.42.6(pid=11782): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11782)] 11:01:05.939249 run osmo-msc_10.42.42.6(pid=11782): stdout: | (launched: 2022-12-13_11:01:04.813933) 11:01:05.989055 run osmo-msc_10.42.42.6(pid=11782): stderr: | 20221213110105083 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110105083 DLGLOBAL DEBUG validating counter group 0x7f134b2aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110105083 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110105084 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110105084 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110105084 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110105086 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110105086 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110105086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110105086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:01:06.038624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11775): Terminating (SIGTERM) 11:01:06.077998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11778): Terminating (SIGTERM) 11:01:06.117543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11781): Terminating (SIGTERM) 11:01:06.157396 --- ParallelTerminationStrategy: PID 11775 died... 11:01:06.176583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11775): Terminated: ok {rc=0} 11:01:06.220620 --- ParallelTerminationStrategy: PID 11778 died... 11:01:06.239472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11778): Terminated: ok {rc=0} 11:01:06.283396 --- ParallelTerminationStrategy: PID 11781 died... 11:01:06.302051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11781): Terminated: ok {rc=0} 11:01:06.385246 bus /sierra_3: Setting Powered False 11:01:07.480138 bus /sierra_3: Setting Powered False 11:01:08.593281 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:01:09.742512 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:01:09.754740 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:01:09.825120 tst mo_mt_call_osmux.py: using LAC 33488 11:01:09.952228 tst mo_mt_call_osmux.py: using RAC 83 11:01:10.078165 tst mo_mt_call_osmux.py: using CellId 33488 11:01:10.203794 tst mo_mt_call_osmux.py: using BVCI 33489 11:01:10.322287 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:01:10.333822 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:01:10.345108 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:01:10.356381 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:01:10.368012 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:01:10.379565 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:01:10.498905 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:01:10.624926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:11.100112 run create_hlr_db(pid=11784): Launched 11:01:11.224548 bus /sierra_2: Setting Powered False 11:01:12.285931 run create_hlr_db(pid=11784): Terminated: ok {rc=0} 11:01:12.732747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11786): Launched 11:01:13.059393 run osmo-hlr_10.42.42.2(pid=11787): Launched 11:01:13.185300 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:13.749688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11789): Launched 11:01:14.077121 run osmo-stp_10.42.42.5(pid=11790): Launched 11:01:14.202357 run osmo-msc_10.42.42.6: Starting osmo-msc 11:01:14.791211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11792): Launched 11:01:15.120213 run osmo-msc_10.42.42.6(pid=11793): Launched 11:01:15.303457 run osmo-stp_10.42.42.5(pid=11790): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11790)] 11:01:15.440759 run osmo-stp_10.42.42.5(pid=11790): stdout: | (launched: 2022-12-13_11:01:14.017313) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:15.579605 run osmo-stp_10.42.42.5(pid=11790): stderr: | 20221213110114211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110114211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110114211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110114212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110114212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110114212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110114212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:15.716926 run osmo-stp_10.42.42.5(pid=11790): stdout: | (launched: 2022-12-13_11:01:14.017313) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:15.846796 run osmo-stp_10.42.42.5(pid=11790): stderr: | 20221213110114211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110114211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110114211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110114212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110114212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110114212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110114212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:16.016098 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11790): Process ended prematurely: osmo-stp_10.42.42.5(pid=11790) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11790)] [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:01:16.026051 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:01:16.054706 run osmo-hlr_10.42.42.2(pid=11787): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11787)] 11:01:16.104613 run osmo-hlr_10.42.42.2(pid=11787): stdout: | (launched: 2022-12-13_11:01:12.999734) 11:01:16.155156 run osmo-hlr_10.42.42.2(pid=11787): stderr: | 20221213110113199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110113199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110113199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110113199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110113199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110113199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110113212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110113220 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110113220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110113220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:16.226172 run osmo-msc_10.42.42.6(pid=11793): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11793)] 11:01:16.276250 run osmo-msc_10.42.42.6(pid=11793): stdout: | (launched: 2022-12-13_11:01:15.060141) 11:01:16.326671 run osmo-msc_10.42.42.6(pid=11793): stderr: | 20221213110115381 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110115381 DLGLOBAL DEBUG validating counter group 0x7f4b5f321c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110115381 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110115381 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110115381 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110115382 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110115383 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110115384 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110115384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110115384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:01:16.378266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11786): Terminating (SIGTERM) 11:01:16.419147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11789): Terminating (SIGTERM) 11:01:16.463122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11792): Terminating (SIGTERM) 11:01:16.506293 --- ParallelTerminationStrategy: PID 11786 died... 11:01:16.526604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11786): Terminated: ok {rc=0} 11:01:16.573518 --- ParallelTerminationStrategy: PID 11789 died... 11:01:16.592870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11789): Terminated: ok {rc=0} 11:01:16.639110 --- ParallelTerminationStrategy: PID 11792 died... 11:01:16.658400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11792): Terminated: ok {rc=0} 11:01:16.750007 bus /sierra_3: Setting Powered False 11:01:17.855771 bus /sierra_3: Setting Powered False 11:01:18.970678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 11:01:20.212168 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:01:20.216565 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 11:01:20.245312 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:01:20.271883 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 11:01:20.355978 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 11:01:20.385847 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:01:20.413772 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 11:01:20.993556 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2388 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 11:01:20.998399 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:01:21.009195 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 11:01:21.053911 tst emergency_mo_mt_call.py: using LAC 33489 11:01:21.173934 tst emergency_mo_mt_call.py: using RAC 84 11:01:21.290099 tst emergency_mo_mt_call.py: using CellId 33489 11:01:21.406513 tst emergency_mo_mt_call.py: using BVCI 33490 11:01:21.514357 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:01:21.525247 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:01:21.535785 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:01:21.546492 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:01:21.557083 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:01:21.568352 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:01:21.688257 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:01:21.807801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:22.306688 run create_hlr_db(pid=11798): Launched 11:01:22.431122 bus /sierra_2: Setting Powered False 11:01:23.494698 run create_hlr_db(pid=11798): Terminated: ok {rc=0} 11:01:23.943027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11800): Launched 11:01:24.265817 run osmo-hlr_10.42.42.2(pid=11801): Launched 11:01:24.389917 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:24.944514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11803): Launched 11:01:25.264883 run osmo-stp_10.42.42.5(pid=11804): Launched 11:01:25.399138 tst emergency_mo_mt_call.py: using MSISDN 8117 11:01:25.566737 run osmo-msc_10.42.42.6: Starting osmo-msc 11:01:26.148502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11806): Launched 11:01:26.471000 run osmo-msc_10.42.42.6(pid=11807): Launched 11:01:26.653615 run osmo-stp_10.42.42.5(pid=11804): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11804)] 11:01:26.789559 run osmo-stp_10.42.42.5(pid=11804): stdout: | (launched: 2022-12-13_11:01:25.205856) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:26.926374 run osmo-stp_10.42.42.5(pid=11804): stderr: | 20221213110125398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110125398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110125398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110125399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110125401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110125401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110125401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:27.061914 run osmo-stp_10.42.42.5(pid=11804): stdout: | (launched: 2022-12-13_11:01:25.205856) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:27.190297 run osmo-stp_10.42.42.5(pid=11804): stderr: | 20221213110125398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110125398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110125398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110125399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110125401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110125401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110125401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:27.343638 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=11804): Process ended prematurely: osmo-stp_10.42.42.5(pid=11804) [trial-2388↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11804)] [trial-2388↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 11:01:27.352868 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 11:01:27.380511 run osmo-hlr_10.42.42.2(pid=11801): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11801)] 11:01:27.431526 run osmo-hlr_10.42.42.2(pid=11801): stdout: | (launched: 2022-12-13_11:01:24.206710) 11:01:27.483821 run osmo-hlr_10.42.42.2(pid=11801): stderr: | 20221213110124404 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110124404 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110124404 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110124404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110124404 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110124404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110124417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110124426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110124426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110124426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:27.557218 run osmo-msc_10.42.42.6(pid=11807): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11807)] 11:01:27.607323 run osmo-msc_10.42.42.6(pid=11807): stdout: | (launched: 2022-12-13_11:01:26.411851) 11:01:27.659252 run osmo-msc_10.42.42.6(pid=11807): stderr: | 20221213110126733 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110126733 DLGLOBAL DEBUG validating counter group 0x7f7702130c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110126733 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110126733 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110126733 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110126734 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110126735 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110126736 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110126736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110126736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:01:27.711622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11800): Terminating (SIGTERM) 11:01:27.753671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11803): Terminating (SIGTERM) 11:01:27.795901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11806): Terminating (SIGTERM) 11:01:27.838347 --- ParallelTerminationStrategy: PID 11800 died... 11:01:27.859052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11800): Terminated: ok {rc=0} 11:01:27.905971 --- ParallelTerminationStrategy: PID 11803 died... 11:01:27.925934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11803): Terminated: ok {rc=0} 11:01:27.972358 --- ParallelTerminationStrategy: PID 11806 died... 11:01:27.992513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11806): Terminated: ok {rc=0} 11:01:28.081564 bus /sierra_3: Setting Powered False 11:01:29.180927 bus /sierra_3: Setting Powered False 11:01:30.297672 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 11:01:31.383694 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:01:31.396463 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 11:01:31.445479 tst emergency_preemptive_call.py: using LAC 33490 11:01:31.577207 tst emergency_preemptive_call.py: using RAC 85 11:01:31.723556 tst emergency_preemptive_call.py: using CellId 33490 11:01:31.852498 tst emergency_preemptive_call.py: using BVCI 33491 11:01:31.971454 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:01:31.983400 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:01:31.995150 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:01:32.006860 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:01:32.019465 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:01:32.032116 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:01:32.155737 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:01:32.279427 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:01:32.396480 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:01:32.515648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:33.015185 run create_hlr_db(pid=11809): Launched 11:01:33.138464 bus /sierra_2: Setting Powered False 11:01:34.202041 run create_hlr_db(pid=11809): Terminated: ok {rc=0} 11:01:34.631873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11811): Launched 11:01:34.931732 run osmo-hlr_10.42.42.2(pid=11812): Launched 11:01:35.046199 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:35.560925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11814): Launched 11:01:35.860430 run osmo-stp_10.42.42.5(pid=11815): Launched 11:01:35.984085 tst emergency_preemptive_call.py: using MSISDN 8118 11:01:36.136769 run osmo-msc_10.42.42.6: Starting osmo-msc 11:01:36.673551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11817): Launched 11:01:36.972464 run osmo-msc_10.42.42.6(pid=11818): Launched 11:01:37.140103 run osmo-stp_10.42.42.5(pid=11815): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11815)] 11:01:37.268819 run osmo-stp_10.42.42.5(pid=11815): stdout: | (launched: 2022-12-13_11:01:35.804805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:37.395113 run osmo-stp_10.42.42.5(pid=11815): stderr: | 20221213110135975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110135976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110135976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110135977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110135978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110135978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110135978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:37.519819 run osmo-stp_10.42.42.5(pid=11815): stdout: | (launched: 2022-12-13_11:01:35.804805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:37.638866 run osmo-stp_10.42.42.5(pid=11815): stderr: | 20221213110135975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110135976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110135976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110135977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110135978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110135978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110135978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:37.782248 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=11815): Process ended prematurely: osmo-stp_10.42.42.5(pid=11815) [trial-2388↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11815)] [trial-2388↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 11:01:37.790533 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 11:01:37.816804 run osmo-hlr_10.42.42.2(pid=11812): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11812)] 11:01:37.865244 run osmo-hlr_10.42.42.2(pid=11812): stdout: | (launched: 2022-12-13_11:01:34.875898) 11:01:37.914823 run osmo-hlr_10.42.42.2(pid=11812): stderr: | 20221213110135053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110135053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110135053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110135053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110135053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110135053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110135065 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110135074 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110135074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110135074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:37.983989 run osmo-msc_10.42.42.6(pid=11818): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11818)] 11:01:38.031784 run osmo-msc_10.42.42.6(pid=11818): stdout: | (launched: 2022-12-13_11:01:36.916923) 11:01:38.081403 run osmo-msc_10.42.42.6(pid=11818): stderr: | 20221213110137189 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110137189 DLGLOBAL DEBUG validating counter group 0x7f955660cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110137189 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110137189 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110137189 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110137189 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110137191 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110137192 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110137192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110137192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:01:38.131158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11811): Terminating (SIGTERM) 11:01:38.170906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11814): Terminating (SIGTERM) 11:01:38.210842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11817): Terminating (SIGTERM) 11:01:38.251010 --- ParallelTerminationStrategy: PID 11811 died... 11:01:38.270361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11811): Terminated: ok {rc=0} 11:01:38.314431 --- ParallelTerminationStrategy: PID 11814 died... 11:01:38.333318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11814): Terminated: ok {rc=0} 11:01:38.377153 --- ParallelTerminationStrategy: PID 11817 died... 11:01:38.395881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11817): Terminated: ok {rc=0} 11:01:38.481224 bus /sierra_9: Setting Powered False 11:01:39.580311 bus /sierra_9: Setting Powered False 11:01:40.694903 bus /sierra_8: Setting Powered False 11:01:41.793493 bus /sierra_8: Setting Powered False 11:01:42.908822 bus /sierra_3: Setting Powered False 11:01:44.007313 bus /sierra_3: Setting Powered False 11:01:45.122711 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 11:01:46.395545 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:01:46.404840 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 11:01:46.442389 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 11:01:46.486325 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 11:01:46.589187 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 11:01:46.622338 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 11:01:46.666416 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 11:01:47.265631 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 11:01:47.316051 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:01:47.326940 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 11:01:47.370713 tst cs_paging_gprs_active.py: using LAC 33491 11:01:47.498506 tst cs_paging_gprs_active.py: using RAC 86 11:01:47.635588 tst cs_paging_gprs_active.py: using CellId 33491 11:01:47.771991 tst cs_paging_gprs_active.py: using BVCI 33492 11:01:47.892217 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:01:47.903644 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:01:47.914866 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:01:47.925912 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:01:47.937638 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:01:47.949506 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:01:47.961386 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:01:47.973259 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:01:47.985499 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:01:48.104545 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:01:48.224237 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:01:48.446704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:48.776808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11823): Launched 11:01:49.061520 run iperf3-srv_10.42.42.10(pid=11824): Launched 11:01:49.183837 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:01:49.404451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:49.733100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11825): Launched 11:01:50.017290 run iperf3-srv_10.42.42.10(pid=11826): Launched 11:01:50.139602 tst cs_paging_gprs_active.py:38: start network... 11:01:50.360436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:50.867408 run create_hlr_db(pid=11827): Launched 11:01:50.991447 bus /sierra_2: Setting Powered False 11:01:52.056133 run create_hlr_db(pid=11827): Terminated: ok {rc=0} 11:01:52.491421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11829): Launched 11:01:52.797138 run osmo-hlr_10.42.42.2(pid=11830): Launched 11:01:52.914197 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:53.439411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11832): Launched 11:01:53.743869 run osmo-stp_10.42.42.5(pid=11833): Launched 11:01:53.860243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:01:54.386539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11835): Launched 11:01:54.504336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:01:54.762704 run patchelf(pid=11836): Launched 11:01:54.932729 run osmo-stp_10.42.42.5(pid=11833): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11833)] 11:01:55.061907 run osmo-stp_10.42.42.5(pid=11833): stdout: | (launched: 2022-12-13_11:01:53.687481) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:55.193557 run osmo-stp_10.42.42.5(pid=11833): stderr: | 20221213110153861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110153861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110153861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110153862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110153862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110153862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110153862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:55.323869 run osmo-stp_10.42.42.5(pid=11833): stdout: | (launched: 2022-12-13_11:01:53.687481) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:55.448429 run osmo-stp_10.42.42.5(pid=11833): stderr: | 20221213110153861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110153861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110153861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110153862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110153862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110153862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110153862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:55.595836 run patchelf(pid=11836): Terminating (SIGINT) 11:01:55.767646 run patchelf(pid=11836): Terminated: ok {rc=0} 11:01:55.891371 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11833): Process ended prematurely: osmo-stp_10.42.42.5(pid=11833) [trial-2388↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11833)] [trial-2388↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 11:01:55.900797 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:01:55.927964 run osmo-hlr_10.42.42.2(pid=11830): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11830)] 11:01:55.975141 run osmo-hlr_10.42.42.2(pid=11830): stdout: | (launched: 2022-12-13_11:01:52.740799) 11:01:56.024285 run osmo-hlr_10.42.42.2(pid=11830): stderr: | 20221213110152917 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110152917 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110152918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110152918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110152918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110152918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110152930 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110152939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110152939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110152939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:56.073686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11823): Terminating (SIGTERM) 11:01:56.113181 run iperf3-srv_10.42.42.10(pid=11824): Terminating (SIGTERM) 11:01:56.152448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11825): Terminating (SIGTERM) 11:01:56.191874 run iperf3-srv_10.42.42.10(pid=11826): Terminating (SIGTERM) 11:01:56.231047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11829): Terminating (SIGTERM) 11:01:56.270222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11832): Terminating (SIGTERM) 11:01:56.309559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11835): Terminating (SIGTERM) 11:01:56.349232 --- ParallelTerminationStrategy: PID 11823 died... 11:01:56.368334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11823): Terminated: ok {rc=0} 11:01:56.412572 --- ParallelTerminationStrategy: PID 11824 died... 11:01:56.431205 run iperf3-srv_10.42.42.10(pid=11824): Terminated {rc=256} 11:01:56.474794 --- ParallelTerminationStrategy: PID 11825 died... 11:01:56.493586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11825): Terminated: ok {rc=0} 11:01:56.537196 --- ParallelTerminationStrategy: PID 11826 died... 11:01:56.555672 run iperf3-srv_10.42.42.10(pid=11826): Terminated {rc=256} 11:01:56.599340 --- ParallelTerminationStrategy: PID 11829 died... 11:01:56.618038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11829): Terminated: ok {rc=0} 11:01:56.661545 --- ParallelTerminationStrategy: PID 11832 died... 11:01:56.680253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11832): Terminated: ok {rc=0} 11:01:56.723902 --- ParallelTerminationStrategy: PID 11835 died... 11:01:56.742712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11835): Terminated: ok {rc=0} 11:01:56.828308 bus /gobi_0: Setting Powered False 11:01:57.928099 bus /gobi_0: Setting Powered False 11:01:59.041534 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 11:02:00.190766 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:00.202740 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 11:02:00.251864 tst iperf3.py: using LAC 33492 11:02:00.378850 tst iperf3.py: using RAC 87 11:02:00.507656 tst iperf3.py: using CellId 33492 11:02:00.640074 tst iperf3.py: using BVCI 33493 11:02:00.759024 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:00.770286 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:00.781311 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:00.792242 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:00.803606 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:00.814909 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:00.826854 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:00.838178 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:00.862634 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:02:01.008390 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:02:01.221301 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:01.543692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11840): Launched 11:02:01.822150 run iperf3-srv_10.42.42.10(pid=11841): Launched 11:02:01.955065 tst iperf3.py:8: start network... 11:02:02.164537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:02.638903 run create_hlr_db(pid=11842): Launched 11:02:02.763927 bus /gobi_6: Setting Powered False 11:02:03.825348 run create_hlr_db(pid=11842): Terminated: ok {rc=0} 11:02:04.247521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11844): Launched 11:02:04.551600 run osmo-hlr_10.42.42.2(pid=11845): Launched 11:02:04.666375 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:05.204871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11847): Launched 11:02:05.508882 run osmo-stp_10.42.42.5(pid=11848): Launched 11:02:05.624540 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:02:06.147012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11850): Launched 11:02:06.262787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:02:06.519612 run patchelf(pid=11851): Launched 11:02:06.688252 run osmo-stp_10.42.42.5(pid=11848): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11848)] 11:02:06.816625 run osmo-stp_10.42.42.5(pid=11848): stdout: | (launched: 2022-12-13_11:02:05.452329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:06.946720 run osmo-stp_10.42.42.5(pid=11848): stderr: | 20221213110205626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110205626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110205626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110205627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110205627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110205627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110205627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:07.076503 run osmo-stp_10.42.42.5(pid=11848): stdout: | (launched: 2022-12-13_11:02:05.452329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:07.201086 run osmo-stp_10.42.42.5(pid=11848): stderr: | 20221213110205626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110205626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110205626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110205627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110205627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110205627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110205627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:07.349318 run patchelf(pid=11851): Terminating (SIGINT) 11:02:07.523885 run patchelf(pid=11851): Terminated: ok {rc=0} 11:02:07.657273 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11848): Process ended prematurely: osmo-stp_10.42.42.5(pid=11848) [trial-2388↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11848)] [trial-2388↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 11:02:07.667743 tst iperf3.py:8: Test FAILED (7.5 sec) 11:02:07.696525 run osmo-hlr_10.42.42.2(pid=11845): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11845)] 11:02:07.747291 run osmo-hlr_10.42.42.2(pid=11845): stdout: | (launched: 2022-12-13_11:02:04.495115) 11:02:07.799290 run osmo-hlr_10.42.42.2(pid=11845): stderr: | 20221213110204676 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110204676 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110204676 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110204676 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110204676 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110204676 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110204688 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110204699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110204699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110204699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:07.851793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11840): Terminating (SIGTERM) 11:02:07.893802 run iperf3-srv_10.42.42.10(pid=11841): Terminating (SIGTERM) 11:02:07.935614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11844): Terminating (SIGTERM) 11:02:07.977673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11847): Terminating (SIGTERM) 11:02:08.020302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11850): Terminating (SIGTERM) 11:02:08.063166 --- ParallelTerminationStrategy: PID 11840 died... 11:02:08.083629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11840): Terminated: ok {rc=0} 11:02:08.130478 --- ParallelTerminationStrategy: PID 11841 died... 11:02:08.150380 run iperf3-srv_10.42.42.10(pid=11841): Terminated {rc=256} 11:02:08.196677 --- ParallelTerminationStrategy: PID 11844 died... 11:02:08.216753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11844): Terminated: ok {rc=0} 11:02:08.263111 --- ParallelTerminationStrategy: PID 11847 died... 11:02:08.283037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11847): Terminated: ok {rc=0} 11:02:08.329519 --- ParallelTerminationStrategy: PID 11850 died... 11:02:08.349722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11850): Terminated: ok {rc=0} 11:02:08.437960 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 11:02:09.584731 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:09.595999 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 11:02:09.641532 tst iperf3m4.py: using LAC 33493 11:02:09.769687 tst iperf3m4.py: using RAC 88 11:02:09.897276 tst iperf3m4.py: using CellId 33493 11:02:10.026826 tst iperf3m4.py: using BVCI 33494 11:02:10.145566 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:10.156921 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:10.168162 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:10.179338 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:10.190786 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:10.202149 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:10.213810 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:10.224844 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:10.236313 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:02:10.354436 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:02:10.476139 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:02:10.594065 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:02:10.714488 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:02:10.918784 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:11.224625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11852): Launched 11:02:11.490208 run iperf3-srv_10.42.42.10(pid=11853): Launched 11:02:11.603619 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:02:11.806782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:12.111622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11854): Launched 11:02:12.375817 run iperf3-srv_10.42.42.10(pid=11855): Launched 11:02:12.489484 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:02:12.692406 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:12.997375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11856): Launched 11:02:13.281329 run iperf3-srv_10.42.42.10(pid=11857): Launched 11:02:13.406194 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:02:13.627040 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:13.955296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11858): Launched 11:02:14.240665 run iperf3-srv_10.42.42.10(pid=11859): Launched 11:02:14.363126 tst iperf3m4.py:8: start network... 11:02:14.583490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:15.089469 run create_hlr_db(pid=11860): Launched 11:02:15.213119 bus /gobi_6: Setting Powered False 11:02:16.276486 run create_hlr_db(pid=11860): Terminated: ok {rc=0} 11:02:16.741666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11862): Launched 11:02:17.093672 run osmo-hlr_10.42.42.2(pid=11863): Launched 11:02:17.229490 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:17.886020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11865): Launched 11:02:18.184815 run osmo-stp_10.42.42.5(pid=11866): Launched 11:02:18.297423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:02:18.812378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11868): Launched 11:02:18.926441 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:02:19.178237 run patchelf(pid=11869): Launched 11:02:19.345839 run osmo-stp_10.42.42.5(pid=11866): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11866)] 11:02:19.471776 run osmo-stp_10.42.42.5(pid=11866): stdout: | (launched: 2022-12-13_11:02:18.129996) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:19.599320 run osmo-stp_10.42.42.5(pid=11866): stderr: | 20221213110218301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110218301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110218302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110218302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110218303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110218303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110218303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:19.726686 run osmo-stp_10.42.42.5(pid=11866): stdout: | (launched: 2022-12-13_11:02:18.129996) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:19.848441 run osmo-stp_10.42.42.5(pid=11866): stderr: | 20221213110218301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110218301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110218302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110218302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110218303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110218303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110218303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:19.992604 run patchelf(pid=11869): Terminating (SIGINT) 11:02:20.159714 run patchelf(pid=11869): Terminated: ok {rc=0} 11:02:20.280743 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11866): Process ended prematurely: osmo-stp_10.42.42.5(pid=11866) [trial-2388↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11866)] [trial-2388↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 11:02:20.290235 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:02:20.317578 run osmo-hlr_10.42.42.2(pid=11863): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11863)] 11:02:20.365042 run osmo-hlr_10.42.42.2(pid=11863): stdout: | (launched: 2022-12-13_11:02:17.025587) 11:02:20.413946 run osmo-hlr_10.42.42.2(pid=11863): stderr: | 20221213110217240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110217240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110217240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110217240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110217240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110217240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110217253 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110217262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110217262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110217262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:20.463060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11852): Terminating (SIGTERM) 11:02:20.502316 run iperf3-srv_10.42.42.10(pid=11853): Terminating (SIGTERM) 11:02:20.541321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11854): Terminating (SIGTERM) 11:02:20.581122 run iperf3-srv_10.42.42.10(pid=11855): Terminating (SIGTERM) 11:02:20.620009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11856): Terminating (SIGTERM) 11:02:20.659144 run iperf3-srv_10.42.42.10(pid=11857): Terminating (SIGTERM) 11:02:20.698178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11858): Terminating (SIGTERM) 11:02:20.737760 run iperf3-srv_10.42.42.10(pid=11859): Terminating (SIGTERM) 11:02:20.777216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11862): Terminating (SIGTERM) 11:02:20.816401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11865): Terminating (SIGTERM) 11:02:20.855608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11868): Terminating (SIGTERM) 11:02:20.895255 --- ParallelTerminationStrategy: PID 11852 died... 11:02:20.914271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11852): Terminated: ok {rc=0} 11:02:20.957781 --- ParallelTerminationStrategy: PID 11853 died... 11:02:20.976309 run iperf3-srv_10.42.42.10(pid=11853): Terminated {rc=256} 11:02:21.019368 --- ParallelTerminationStrategy: PID 11854 died... 11:02:21.037812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11854): Terminated: ok {rc=0} 11:02:21.081028 --- ParallelTerminationStrategy: PID 11855 died... 11:02:21.099654 run iperf3-srv_10.42.42.10(pid=11855): Terminated {rc=256} 11:02:21.142851 --- ParallelTerminationStrategy: PID 11856 died... 11:02:21.161414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11856): Terminated: ok {rc=0} 11:02:21.204661 --- ParallelTerminationStrategy: PID 11857 died... 11:02:21.223155 run iperf3-srv_10.42.42.10(pid=11857): Terminated {rc=256} 11:02:21.266379 --- ParallelTerminationStrategy: PID 11858 died... 11:02:21.284796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11858): Terminated: ok {rc=0} 11:02:21.328398 --- ParallelTerminationStrategy: PID 11859 died... 11:02:21.347242 run iperf3-srv_10.42.42.10(pid=11859): Terminated {rc=256} 11:02:21.390701 --- ParallelTerminationStrategy: PID 11862 died... 11:02:21.409307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11862): Terminated: ok {rc=0} 11:02:21.452558 --- ParallelTerminationStrategy: PID 11865 died... 11:02:21.471127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11865): Terminated: ok {rc=0} 11:02:21.514384 --- ParallelTerminationStrategy: PID 11868 died... 11:02:21.532613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11868): Terminated: ok {rc=0} 11:02:21.617239 bus /gobi_4: Setting Powered False 11:02:22.716233 bus /gobi_4: Setting Powered False 11:02:23.828828 bus /gobi_1: Setting Powered False 11:02:24.925836 bus /gobi_1: Setting Powered False 11:02:26.041619 bus /gobi_0: Setting Powered False 11:02:27.139281 bus /gobi_0: Setting Powered False 11:02:28.255646 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 11:02:29.357804 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:29.369452 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 11:02:29.419331 tst ping.py: using LAC 33494 11:02:29.534826 tst ping.py: using RAC 89 11:02:29.652016 tst ping.py: using CellId 33494 11:02:29.767733 tst ping.py: using BVCI 33495 11:02:29.873938 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:29.884652 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:29.895592 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:29.906055 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:29.916289 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:29.926703 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:29.937173 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:29.947591 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:02:30.064846 tst ping.py:19: start network... 11:02:30.277169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:30.765142 run create_hlr_db(pid=11870): Launched 11:02:30.889828 bus /gobi_6: Setting Powered False 11:02:31.955053 run create_hlr_db(pid=11870): Terminated: ok {rc=0} 11:02:32.401120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11872): Launched 11:02:32.717147 run osmo-hlr_10.42.42.2(pid=11873): Launched 11:02:32.838415 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:33.385577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11875): Launched 11:02:33.701169 run osmo-stp_10.42.42.5(pid=11876): Launched 11:02:33.822561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:02:34.367027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11878): Launched 11:02:34.486968 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:02:34.753332 run patchelf(pid=11879): Launched 11:02:34.929347 run osmo-stp_10.42.42.5(pid=11876): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11876)] 11:02:35.063096 run osmo-stp_10.42.42.5(pid=11876): stdout: | (launched: 2022-12-13_11:02:33.643483) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:35.198432 run osmo-stp_10.42.42.5(pid=11876): stderr: | 20221213110233835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110233835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110233835 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110233835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110233839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110233839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110233839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:35.333581 run osmo-stp_10.42.42.5(pid=11876): stdout: | (launched: 2022-12-13_11:02:33.643483) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:35.463141 run osmo-stp_10.42.42.5(pid=11876): stderr: | 20221213110233835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110233835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110233835 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110233835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110233839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110233839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110233839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:35.616998 run patchelf(pid=11879): Terminating (SIGINT) 11:02:35.793694 run patchelf(pid=11879): Terminated: ok {rc=0} 11:02:35.921254 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11876): Process ended prematurely: osmo-stp_10.42.42.5(pid=11876) [trial-2388↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11876)] [trial-2388↪gprs:trx-lms-limenet-micro↪ping.py:22] 11:02:35.930958 tst ping.py:22: Test FAILED (6.6 sec) 11:02:35.958865 run osmo-hlr_10.42.42.2(pid=11873): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11873)] 11:02:36.009962 run osmo-hlr_10.42.42.2(pid=11873): stdout: | (launched: 2022-12-13_11:02:32.659480) 11:02:36.062465 run osmo-hlr_10.42.42.2(pid=11873): stderr: | 20221213110232857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110232857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110232857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110232857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110232857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110232857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110232870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110232878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110232878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110232878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:36.115691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11872): Terminating (SIGTERM) 11:02:36.157232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11875): Terminating (SIGTERM) 11:02:36.199083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11878): Terminating (SIGTERM) 11:02:36.241272 --- ParallelTerminationStrategy: PID 11872 died... 11:02:36.261519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11872): Terminated: ok {rc=0} 11:02:36.307658 --- ParallelTerminationStrategy: PID 11875 died... 11:02:36.327311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11875): Terminated: ok {rc=0} 11:02:36.373454 --- ParallelTerminationStrategy: PID 11878 died... 11:02:36.393166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11878): Terminated: ok {rc=0} 11:02:36.481236 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 11:02:37.568094 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:37.579947 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 11:02:37.625681 tst ping_idle_ping.py: using LAC 33495 11:02:37.750877 tst ping_idle_ping.py: using RAC 90 11:02:37.875038 tst ping_idle_ping.py: using CellId 33495 11:02:37.998652 tst ping_idle_ping.py: using BVCI 33496 11:02:38.113183 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:38.124507 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:38.135618 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:38.146635 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:38.158024 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:38.169277 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:38.180693 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 11:02:38.192004 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 11:02:38.309568 tst ping_idle_ping.py:24: start network... 11:02:38.507788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:38.969446 run create_hlr_db(pid=11880): Launched 11:02:39.090384 bus /gobi_6: Setting Powered False 11:02:40.149438 run create_hlr_db(pid=11880): Terminated: ok {rc=0} 11:02:40.563590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11882): Launched 11:02:40.858579 run osmo-hlr_10.42.42.2(pid=11883): Launched 11:02:40.970502 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:41.496870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11885): Launched 11:02:41.794531 run osmo-stp_10.42.42.5(pid=11886): Launched 11:02:41.907427 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:02:42.418889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11888): Launched 11:02:42.532020 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:02:42.782092 run patchelf(pid=11889): Launched 11:02:42.945966 run osmo-stp_10.42.42.5(pid=11886): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11886)] 11:02:43.070977 run osmo-stp_10.42.42.5(pid=11886): stdout: | (launched: 2022-12-13_11:02:41.740072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:43.197719 run osmo-stp_10.42.42.5(pid=11886): stderr: | 20221213110241910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110241910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110241911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110241911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110241912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110241912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110241912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:43.324443 run osmo-stp_10.42.42.5(pid=11886): stdout: | (launched: 2022-12-13_11:02:41.740072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:43.445642 run osmo-stp_10.42.42.5(pid=11886): stderr: | 20221213110241910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110241910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110241911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110241911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110241912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110241912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110241912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:43.590248 run patchelf(pid=11889): Terminating (SIGINT) 11:02:43.756464 run patchelf(pid=11889): Terminated: ok {rc=0} 11:02:43.876099 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11886): Process ended prematurely: osmo-stp_10.42.42.5(pid=11886) [trial-2388↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11886)] [trial-2388↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 11:02:43.884905 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 11:02:43.911080 run osmo-hlr_10.42.42.2(pid=11883): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11883)] 11:02:43.957984 run osmo-hlr_10.42.42.2(pid=11883): stdout: | (launched: 2022-12-13_11:02:40.804115) 11:02:44.006946 run osmo-hlr_10.42.42.2(pid=11883): stderr: | 20221213110240980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110240980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110240980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110240980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110240980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110240981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110240993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110241002 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110241002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110241002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:44.056345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11882): Terminating (SIGTERM) 11:02:44.095661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11885): Terminating (SIGTERM) 11:02:44.134908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11888): Terminating (SIGTERM) 11:02:44.174509 --- ParallelTerminationStrategy: PID 11882 died... 11:02:44.193647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11882): Terminated: ok {rc=0} 11:02:44.237194 --- ParallelTerminationStrategy: PID 11885 died... 11:02:44.255986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11885): Terminated: ok {rc=0} 11:02:44.299287 --- ParallelTerminationStrategy: PID 11888 died... 11:02:44.317693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11888): Terminated: ok {rc=0} 11:02:44.403219 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 11:02:45.696659 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:02:45.701743 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:02:45.729961 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:02:45.767561 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:02:45.856919 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:02:45.887829 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:02:45.939800 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:02:46.519003 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:02:46.583437 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:46.597576 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:02:46.652119 tst cs_paging_gprs_active.py: using LAC 33496 11:02:46.797942 tst cs_paging_gprs_active.py: using RAC 91 11:02:46.921361 tst cs_paging_gprs_active.py: using CellId 33496 11:02:47.040680 tst cs_paging_gprs_active.py: using BVCI 33497 11:02:47.189975 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:47.202484 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:47.215699 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:47.228359 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:47.242518 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:47.256373 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:47.269751 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:47.282802 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:47.296011 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:02:47.424157 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:02:47.541280 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:02:47.743543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:48.046211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11893): Launched 11:02:48.308167 run iperf3-srv_10.42.42.10(pid=11894): Launched 11:02:48.420509 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:02:48.622138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:48.925764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11895): Launched 11:02:49.187482 run iperf3-srv_10.42.42.10(pid=11896): Launched 11:02:49.299908 tst cs_paging_gprs_active.py:38: start network... 11:02:49.502055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:49.969993 run create_hlr_db(pid=11897): Launched 11:02:50.092900 bus /gobi_6: Setting Powered False 11:02:51.153548 run create_hlr_db(pid=11897): Terminated: ok {rc=0} 11:02:51.574186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11899): Launched 11:02:51.874593 run osmo-hlr_10.42.42.2(pid=11900): Launched 11:02:51.989207 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:52.506884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11902): Launched 11:02:52.807016 run osmo-stp_10.42.42.5(pid=11903): Launched 11:02:52.921678 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:02:53.441729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11905): Launched 11:02:53.556433 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:02:53.812242 run patchelf(pid=11906): Launched 11:02:53.979458 run osmo-stp_10.42.42.5(pid=11903): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11903)] 11:02:54.107619 run osmo-stp_10.42.42.5(pid=11903): stdout: | (launched: 2022-12-13_11:02:52.751660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:54.236152 run osmo-stp_10.42.42.5(pid=11903): stderr: | 20221213110252924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110252924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110252925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110252925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110252926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110252926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110252926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:54.365105 run osmo-stp_10.42.42.5(pid=11903): stdout: | (launched: 2022-12-13_11:02:52.751660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:54.488589 run osmo-stp_10.42.42.5(pid=11903): stderr: | 20221213110252924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110252924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110252925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110252925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110252926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110252926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110252926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:54.634522 run patchelf(pid=11906): Terminating (SIGINT) 11:02:54.803607 run patchelf(pid=11906): Terminated: ok {rc=0} 11:02:54.925690 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11903): Process ended prematurely: osmo-stp_10.42.42.5(pid=11903) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11903)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:02:54.935612 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 11:02:54.962428 run osmo-hlr_10.42.42.2(pid=11900): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11900)] 11:02:55.009692 run osmo-hlr_10.42.42.2(pid=11900): stdout: | (launched: 2022-12-13_11:02:51.819006) 11:02:55.058513 run osmo-hlr_10.42.42.2(pid=11900): stderr: | 20221213110251995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110251995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110251995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110251995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110251995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110251995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110252007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110252016 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110252016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110252016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:55.107964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11893): Terminating (SIGTERM) 11:02:55.147392 run iperf3-srv_10.42.42.10(pid=11894): Terminating (SIGTERM) 11:02:55.186705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11895): Terminating (SIGTERM) 11:02:55.226218 run iperf3-srv_10.42.42.10(pid=11896): Terminating (SIGTERM) 11:02:55.265453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11899): Terminating (SIGTERM) 11:02:55.305096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11902): Terminating (SIGTERM) 11:02:55.344606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11905): Terminating (SIGTERM) 11:02:55.384294 --- ParallelTerminationStrategy: PID 11893 died... 11:02:55.402767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11893): Terminated: ok {rc=0} 11:02:55.446418 --- ParallelTerminationStrategy: PID 11894 died... 11:02:55.464684 run iperf3-srv_10.42.42.10(pid=11894): Terminated {rc=256} 11:02:55.508191 --- ParallelTerminationStrategy: PID 11895 died... 11:02:55.526597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11895): Terminated: ok {rc=0} 11:02:55.570151 --- ParallelTerminationStrategy: PID 11896 died... 11:02:55.588567 run iperf3-srv_10.42.42.10(pid=11896): Terminated {rc=256} 11:02:55.632449 --- ParallelTerminationStrategy: PID 11899 died... 11:02:55.650945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11899): Terminated: ok {rc=0} 11:02:55.694451 --- ParallelTerminationStrategy: PID 11902 died... 11:02:55.712874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11902): Terminated: ok {rc=0} 11:02:55.756374 --- ParallelTerminationStrategy: PID 11905 died... 11:02:55.774865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11905): Terminated: ok {rc=0} 11:02:55.860395 bus /gobi_0: Setting Powered False 11:02:56.961290 bus /gobi_0: Setting Powered False 11:02:58.077406 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:02:59.225993 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:59.238190 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:02:59.286328 tst iperf3.py: using LAC 33497 11:02:59.413392 tst iperf3.py: using RAC 92 11:02:59.539572 tst iperf3.py: using CellId 33497 11:02:59.666754 tst iperf3.py: using BVCI 33498 11:02:59.783052 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:59.794601 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:59.805824 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:59.816939 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:59.828493 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:59.839991 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:59.851560 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:59.862963 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:02:59.874631 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:02:59.995016 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:03:00.212882 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:00.537998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11907): Launched 11:03:00.819197 run iperf3-srv_10.42.42.10(pid=11908): Launched 11:03:00.956795 tst iperf3.py:8: start network... 11:03:01.165243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:01.648920 run create_hlr_db(pid=11910): Launched 11:03:01.804411 bus /gobi_6: Setting Powered False 11:03:02.864794 run create_hlr_db(pid=11910): Terminated: ok {rc=0} 11:03:03.284129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11912): Launched 11:03:03.584219 run osmo-hlr_10.42.42.2(pid=11913): Launched 11:03:03.700106 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:04.230456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11915): Launched 11:03:04.530407 run osmo-stp_10.42.42.5(pid=11916): Launched 11:03:04.644092 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:05.160062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11918): Launched 11:03:05.274129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:05.526859 run patchelf(pid=11919): Launched 11:03:05.693493 run osmo-stp_10.42.42.5(pid=11916): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11916)] 11:03:05.820525 run osmo-stp_10.42.42.5(pid=11916): stdout: | (launched: 2022-12-13_11:03:04.475182) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:05.948577 run osmo-stp_10.42.42.5(pid=11916): stderr: | 20221213110304647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110304647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110304648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110304648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110304649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110304649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110304649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:06.076517 run osmo-stp_10.42.42.5(pid=11916): stdout: | (launched: 2022-12-13_11:03:04.475182) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:06.198991 run osmo-stp_10.42.42.5(pid=11916): stderr: | 20221213110304647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110304647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110304648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110304648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110304649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110304649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110304649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:06.344184 run patchelf(pid=11919): Terminating (SIGINT) 11:03:06.512878 run patchelf(pid=11919): Terminated: ok {rc=0} 11:03:06.634954 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11916): Process ended prematurely: osmo-stp_10.42.42.5(pid=11916) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11916)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 11:03:06.644249 tst iperf3.py:8: Test FAILED (7.5 sec) 11:03:06.670926 run osmo-hlr_10.42.42.2(pid=11913): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11913)] 11:03:06.718616 run osmo-hlr_10.42.42.2(pid=11913): stdout: | (launched: 2022-12-13_11:03:03.528675) 11:03:06.767417 run osmo-hlr_10.42.42.2(pid=11913): stderr: | 20221213110303707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110303707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110303707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110303707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110303707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110303707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110303719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110303728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110303729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110303729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:06.816862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11907): Terminating (SIGTERM) 11:03:06.856566 run iperf3-srv_10.42.42.10(pid=11908): Terminating (SIGTERM) 11:03:06.895846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11912): Terminating (SIGTERM) 11:03:06.935403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11915): Terminating (SIGTERM) 11:03:06.974841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11918): Terminating (SIGTERM) 11:03:07.014440 --- ParallelTerminationStrategy: PID 11907 died... 11:03:07.033081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11907): Terminated: ok {rc=0} 11:03:07.076823 --- ParallelTerminationStrategy: PID 11908 died... 11:03:07.095331 run iperf3-srv_10.42.42.10(pid=11908): Terminated {rc=256} 11:03:07.138784 --- ParallelTerminationStrategy: PID 11912 died... 11:03:07.157186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11912): Terminated: ok {rc=0} 11:03:07.200726 --- ParallelTerminationStrategy: PID 11915 died... 11:03:07.219238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11915): Terminated: ok {rc=0} 11:03:07.262776 --- ParallelTerminationStrategy: PID 11918 died... 11:03:07.281298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11918): Terminated: ok {rc=0} 11:03:07.363802 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:03:08.513715 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:08.525922 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:03:08.573728 tst iperf3m4.py: using LAC 33498 11:03:08.691411 tst iperf3m4.py: using RAC 93 11:03:08.809195 tst iperf3m4.py: using CellId 33498 11:03:08.926875 tst iperf3m4.py: using BVCI 33499 11:03:09.037340 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:09.048418 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:09.059355 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:09.070216 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:09.081039 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:09.091750 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:09.102564 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:09.113167 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:09.123890 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:09.251439 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:09.368791 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:09.490955 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:09.614195 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:03:09.831752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:10.155270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11920): Launched 11:03:10.436186 run iperf3-srv_10.42.42.10(pid=11921): Launched 11:03:10.557167 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:03:10.784536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:11.107203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11922): Launched 11:03:11.388332 run iperf3-srv_10.42.42.10(pid=11923): Launched 11:03:11.508599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:03:11.726160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:12.049536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11924): Launched 11:03:12.328930 run iperf3-srv_10.42.42.10(pid=11925): Launched 11:03:12.450736 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:03:12.667803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:12.991839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11926): Launched 11:03:13.270914 run iperf3-srv_10.42.42.10(pid=11927): Launched 11:03:13.390949 tst iperf3m4.py:8: start network... 11:03:13.608155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:14.106950 run create_hlr_db(pid=11928): Launched 11:03:14.229681 bus /gobi_6: Setting Powered False 11:03:15.293190 run create_hlr_db(pid=11928): Terminated: ok {rc=0} 11:03:15.723672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11930): Launched 11:03:16.070754 run osmo-hlr_10.42.42.2(pid=11931): Launched 11:03:16.247404 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:17.041681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11933): Launched 11:03:17.353956 run osmo-stp_10.42.42.5(pid=11934): Launched 11:03:17.494526 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:18.055384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11936): Launched 11:03:18.178946 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:18.451879 run patchelf(pid=11937): Launched 11:03:18.631911 run osmo-stp_10.42.42.5(pid=11934): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11934)] 11:03:18.769238 run osmo-stp_10.42.42.5(pid=11934): stdout: | (launched: 2022-12-13_11:03:17.297728) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:18.907501 run osmo-stp_10.42.42.5(pid=11934): stderr: | 20221213110317505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110317505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110317505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110317506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110317506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110317506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110317506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:19.046135 run osmo-stp_10.42.42.5(pid=11934): stdout: | (launched: 2022-12-13_11:03:17.297728) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:19.179116 run osmo-stp_10.42.42.5(pid=11934): stderr: | 20221213110317505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110317505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110317505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110317506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110317506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110317506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110317506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:19.336163 run patchelf(pid=11937): Terminating (SIGINT) 11:03:19.516821 run patchelf(pid=11937): Terminated: ok {rc=0} 11:03:19.648408 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11934): Process ended prematurely: osmo-stp_10.42.42.5(pid=11934) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11934)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 11:03:19.658959 tst iperf3m4.py:8: Test FAILED (11.2 sec) 11:03:19.687706 run osmo-hlr_10.42.42.2(pid=11931): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11931)] 11:03:19.738762 run osmo-hlr_10.42.42.2(pid=11931): stdout: | (launched: 2022-12-13_11:03:16.001134) 11:03:19.791774 run osmo-hlr_10.42.42.2(pid=11931): stderr: | 20221213110316352 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110316352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110316352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110316352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110316361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110316361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110316380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110316393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110316393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110316393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:19.845092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11920): Terminating (SIGTERM) 11:03:19.887020 run iperf3-srv_10.42.42.10(pid=11921): Terminating (SIGTERM) 11:03:19.929899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11922): Terminating (SIGTERM) 11:03:19.972426 run iperf3-srv_10.42.42.10(pid=11923): Terminating (SIGTERM) 11:03:20.015372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11924): Terminating (SIGTERM) 11:03:20.058124 run iperf3-srv_10.42.42.10(pid=11925): Terminating (SIGTERM) 11:03:20.100847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11926): Terminating (SIGTERM) 11:03:20.143525 run iperf3-srv_10.42.42.10(pid=11927): Terminating (SIGTERM) 11:03:20.186492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11930): Terminating (SIGTERM) 11:03:20.229270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11933): Terminating (SIGTERM) 11:03:20.271706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11936): Terminating (SIGTERM) 11:03:20.314476 --- ParallelTerminationStrategy: PID 11920 died... 11:03:20.334532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11920): Terminated: ok {rc=0} 11:03:20.381258 --- ParallelTerminationStrategy: PID 11921 died... 11:03:20.401113 run iperf3-srv_10.42.42.10(pid=11921): Terminated {rc=256} 11:03:20.447464 --- ParallelTerminationStrategy: PID 11922 died... 11:03:20.467299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11922): Terminated: ok {rc=0} 11:03:20.513779 --- ParallelTerminationStrategy: PID 11923 died... 11:03:20.533713 run iperf3-srv_10.42.42.10(pid=11923): Terminated {rc=256} 11:03:20.580233 --- ParallelTerminationStrategy: PID 11924 died... 11:03:20.600541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11924): Terminated: ok {rc=0} 11:03:20.646986 --- ParallelTerminationStrategy: PID 11925 died... 11:03:20.666850 run iperf3-srv_10.42.42.10(pid=11925): Terminated {rc=256} 11:03:20.713365 --- ParallelTerminationStrategy: PID 11926 died... 11:03:20.733407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11926): Terminated: ok {rc=0} 11:03:20.779775 --- ParallelTerminationStrategy: PID 11927 died... 11:03:20.799704 run iperf3-srv_10.42.42.10(pid=11927): Terminated {rc=256} 11:03:20.846080 --- ParallelTerminationStrategy: PID 11930 died... 11:03:20.865974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11930): Terminated: ok {rc=0} 11:03:20.912470 --- ParallelTerminationStrategy: PID 11933 died... 11:03:20.932467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11933): Terminated: ok {rc=0} 11:03:20.978872 --- ParallelTerminationStrategy: PID 11936 died... 11:03:20.999032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11936): Terminated: ok {rc=0} 11:03:21.087580 bus /gobi_4: Setting Powered False 11:03:22.186747 bus /gobi_4: Setting Powered False 11:03:23.304907 bus /gobi_1: Setting Powered False 11:03:24.404343 bus /gobi_1: Setting Powered False 11:03:25.522195 bus /gobi_0: Setting Powered False 11:03:26.621261 bus /gobi_0: Setting Powered False 11:03:27.739504 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 11:03:28.842250 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:28.854403 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:03:28.901915 tst ping.py: using LAC 33499 11:03:29.025381 tst ping.py: using RAC 94 11:03:29.149073 tst ping.py: using CellId 33499 11:03:29.273588 tst ping.py: using BVCI 33500 11:03:29.382289 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.393557 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.404431 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.415371 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.426627 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.437933 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.449399 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.460649 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:29.576359 tst ping.py:19: start network... 11:03:29.772850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:30.230852 run create_hlr_db(pid=11938): Launched 11:03:30.350001 bus /gobi_6: Setting Powered False 11:03:31.412523 run create_hlr_db(pid=11938): Terminated: ok {rc=0} 11:03:31.890733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11940): Launched 11:03:32.233491 run osmo-hlr_10.42.42.2(pid=11941): Launched 11:03:32.370632 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:32.920813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11943): Launched 11:03:33.237347 run osmo-stp_10.42.42.5(pid=11944): Launched 11:03:33.358791 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:33.908053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11946): Launched 11:03:34.029862 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:34.297800 run patchelf(pid=11947): Launched 11:03:34.473355 run osmo-stp_10.42.42.5(pid=11944): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11944)] 11:03:34.608488 run osmo-stp_10.42.42.5(pid=11944): stdout: | (launched: 2022-12-13_11:03:33.178958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:34.743970 run osmo-stp_10.42.42.5(pid=11944): stderr: | 20221213110333373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110333373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110333373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110333374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110333374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110333374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110333374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:34.879792 run osmo-stp_10.42.42.5(pid=11944): stdout: | (launched: 2022-12-13_11:03:33.178958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:35.010157 run osmo-stp_10.42.42.5(pid=11944): stderr: | 20221213110333373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110333373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110333373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110333374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110333374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110333374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110333374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:35.164055 run patchelf(pid=11947): Terminating (SIGINT) 11:03:35.342676 run patchelf(pid=11947): Terminated: ok {rc=0} 11:03:35.471733 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11944): Process ended prematurely: osmo-stp_10.42.42.5(pid=11944) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11944)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 11:03:35.481443 tst ping.py:22: Test FAILED (6.6 sec) 11:03:35.509564 run osmo-hlr_10.42.42.2(pid=11941): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11941)] 11:03:35.560606 run osmo-hlr_10.42.42.2(pid=11941): stdout: | (launched: 2022-12-13_11:03:32.171753) 11:03:35.613537 run osmo-hlr_10.42.42.2(pid=11941): stderr: | 20221213110332385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110332385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110332385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110332385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110332385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110332385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110332397 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110332405 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110332405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110332405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:35.666458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11940): Terminating (SIGTERM) 11:03:35.708809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11943): Terminating (SIGTERM) 11:03:35.751184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11946): Terminating (SIGTERM) 11:03:35.793806 --- ParallelTerminationStrategy: PID 11940 died... 11:03:35.814278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11940): Terminated: ok {rc=0} 11:03:35.861277 --- ParallelTerminationStrategy: PID 11943 died... 11:03:35.881251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11943): Terminated: ok {rc=0} 11:03:35.927977 --- ParallelTerminationStrategy: PID 11946 died... 11:03:35.948064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11946): Terminated: ok {rc=0} 11:03:36.036727 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:03:37.124889 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:37.136579 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:03:37.183729 tst ping_idle_ping.py: using LAC 33500 11:03:37.309247 tst ping_idle_ping.py: using RAC 95 11:03:37.435366 tst ping_idle_ping.py: using CellId 33500 11:03:37.558874 tst ping_idle_ping.py: using BVCI 33501 11:03:37.674706 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:37.686414 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:37.697645 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:37.708835 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:37.720294 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:37.731747 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:37.743442 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:37.755071 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:37.870236 tst ping_idle_ping.py:24: start network... 11:03:38.084563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:38.578027 run create_hlr_db(pid=11948): Launched 11:03:38.699810 bus /gobi_6: Setting Powered False 11:03:39.762337 run create_hlr_db(pid=11948): Terminated: ok {rc=0} 11:03:40.194222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11950): Launched 11:03:40.490868 run osmo-hlr_10.42.42.2(pid=11951): Launched 11:03:40.606409 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:41.134318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11953): Launched 11:03:41.430615 run osmo-stp_10.42.42.5(pid=11954): Launched 11:03:41.542815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:42.054497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11956): Launched 11:03:42.167451 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:42.417348 run patchelf(pid=11957): Launched 11:03:42.582044 run osmo-stp_10.42.42.5(pid=11954): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11954)] 11:03:42.707978 run osmo-stp_10.42.42.5(pid=11954): stdout: | (launched: 2022-12-13_11:03:41.375135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:42.835442 run osmo-stp_10.42.42.5(pid=11954): stderr: | 20221213110341544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110341544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110341544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110341545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110341547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110341547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110341547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:42.962785 run osmo-stp_10.42.42.5(pid=11954): stdout: | (launched: 2022-12-13_11:03:41.375135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:43.084533 run osmo-stp_10.42.42.5(pid=11954): stderr: | 20221213110341544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110341544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110341544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110341545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110341547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110341547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110341547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:43.229008 run patchelf(pid=11957): Terminating (SIGINT) 11:03:43.395751 run patchelf(pid=11957): Terminated: ok {rc=0} 11:03:43.516271 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11954): Process ended prematurely: osmo-stp_10.42.42.5(pid=11954) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11954)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 11:03:43.525291 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 11:03:43.551744 run osmo-hlr_10.42.42.2(pid=11951): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11951)] 11:03:43.599373 run osmo-hlr_10.42.42.2(pid=11951): stdout: | (launched: 2022-12-13_11:03:40.435869) 11:03:43.648485 run osmo-hlr_10.42.42.2(pid=11951): stderr: | 20221213110340612 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110340612 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110340612 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110340612 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110340612 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110340612 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110340623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110340632 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110340632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110340632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:43.697784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11950): Terminating (SIGTERM) 11:03:43.737483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11953): Terminating (SIGTERM) 11:03:43.777233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11956): Terminating (SIGTERM) 11:03:43.817633 --- ParallelTerminationStrategy: PID 11950 died... 11:03:43.836866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11950): Terminated: ok {rc=0} 11:03:43.880693 --- ParallelTerminationStrategy: PID 11953 died... 11:03:43.899511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11953): Terminated: ok {rc=0} 11:03:43.943171 --- ParallelTerminationStrategy: PID 11956 died... 11:03:43.961731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11956): Terminated: ok {rc=0} 11:03:44.044774 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:03:45.344389 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:03:45.350396 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:03:45.378884 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:03:45.417813 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:03:45.503946 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:03:45.532741 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:03:45.571123 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:03:46.179298 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:03:46.235818 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:46.248426 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:03:46.317661 tst cs_paging_gprs_active.py: using LAC 33501 11:03:46.441301 tst cs_paging_gprs_active.py: using RAC 96 11:03:46.570520 tst cs_paging_gprs_active.py: using CellId 33501 11:03:46.707401 tst cs_paging_gprs_active.py: using BVCI 33502 11:03:46.833289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:46.845931 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:46.859252 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:46.871589 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:46.885133 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:46.898495 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:46.911899 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:46.924587 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:46.937815 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:03:47.064487 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:03:47.195167 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:03:47.401220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:47.706067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11961): Launched 11:03:47.969461 run iperf3-srv_10.42.42.10(pid=11962): Launched 11:03:48.082858 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:03:48.283925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:48.587056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11963): Launched 11:03:48.850514 run iperf3-srv_10.42.42.10(pid=11964): Launched 11:03:48.963172 tst cs_paging_gprs_active.py:38: start network... 11:03:49.165297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:49.633699 run create_hlr_db(pid=11965): Launched 11:03:49.756702 bus /gobi_6: Setting Powered False 11:03:50.817720 run create_hlr_db(pid=11965): Terminated: ok {rc=0} 11:03:51.260580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11967): Launched 11:03:51.585177 run osmo-hlr_10.42.42.2(pid=11968): Launched 11:03:51.711491 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:52.270966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11970): Launched 11:03:52.594791 run osmo-stp_10.42.42.5(pid=11971): Launched 11:03:52.721160 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:53.283302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11973): Launched 11:03:53.408632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:53.683881 run patchelf(pid=11974): Launched 11:03:53.865761 run osmo-stp_10.42.42.5(pid=11971): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11971)] 11:03:54.003823 run osmo-stp_10.42.42.5(pid=11971): stdout: | (launched: 2022-12-13_11:03:52.535842) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:54.143460 run osmo-stp_10.42.42.5(pid=11971): stderr: | 20221213110352728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110352728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110352729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110352729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110352729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110352729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110352729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:54.282866 run osmo-stp_10.42.42.5(pid=11971): stdout: | (launched: 2022-12-13_11:03:52.535842) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:54.416271 run osmo-stp_10.42.42.5(pid=11971): stderr: | 20221213110352728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110352728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110352729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110352729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110352729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110352729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110352729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:54.574329 run patchelf(pid=11974): Terminating (SIGINT) 11:03:54.757421 run patchelf(pid=11974): Terminated: ok {rc=0} 11:03:54.889502 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11971): Process ended prematurely: osmo-stp_10.42.42.5(pid=11971) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11971)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:03:54.899540 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:03:54.928139 run osmo-hlr_10.42.42.2(pid=11968): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11968)] 11:03:54.979478 run osmo-hlr_10.42.42.2(pid=11968): stdout: | (launched: 2022-12-13_11:03:51.525960) 11:03:55.032358 run osmo-hlr_10.42.42.2(pid=11968): stderr: | 20221213110351726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110351726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110351726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110351726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110351726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110351726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110351739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110351747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110351747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110351747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:55.085360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11961): Terminating (SIGTERM) 11:03:55.127294 run iperf3-srv_10.42.42.10(pid=11962): Terminating (SIGTERM) 11:03:55.170080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11963): Terminating (SIGTERM) 11:03:55.212465 run iperf3-srv_10.42.42.10(pid=11964): Terminating (SIGTERM) 11:03:55.254968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11967): Terminating (SIGTERM) 11:03:55.297596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11970): Terminating (SIGTERM) 11:03:55.340843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11973): Terminating (SIGTERM) 11:03:55.383407 --- ParallelTerminationStrategy: PID 11961 died... 11:03:55.403906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11961): Terminated: ok {rc=0} 11:03:55.450961 --- ParallelTerminationStrategy: PID 11962 died... 11:03:55.470799 run iperf3-srv_10.42.42.10(pid=11962): Terminated {rc=256} 11:03:55.516909 --- ParallelTerminationStrategy: PID 11963 died... 11:03:55.537289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11963): Terminated: ok {rc=0} 11:03:55.583535 --- ParallelTerminationStrategy: PID 11964 died... 11:03:55.603228 run iperf3-srv_10.42.42.10(pid=11964): Terminated {rc=256} 11:03:55.649823 --- ParallelTerminationStrategy: PID 11967 died... 11:03:55.669744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11967): Terminated: ok {rc=0} 11:03:55.715875 --- ParallelTerminationStrategy: PID 11970 died... 11:03:55.735806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11970): Terminated: ok {rc=0} 11:03:55.781877 --- ParallelTerminationStrategy: PID 11973 died... 11:03:55.801751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11973): Terminated: ok {rc=0} 11:03:55.888847 bus /gobi_0: Setting Powered False 11:03:56.987879 bus /gobi_0: Setting Powered False 11:03:58.104299 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:03:59.253643 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:59.265987 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:03:59.340783 tst iperf3.py: using LAC 33502 11:03:59.475369 tst iperf3.py: using RAC 97 11:03:59.603463 tst iperf3.py: using CellId 33502 11:03:59.723738 tst iperf3.py: using BVCI 33503 11:03:59.832863 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:59.843893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:59.854882 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:59.865878 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:59.876482 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:59.887232 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:59.898120 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:59.909392 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:03:59.920374 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:00.040667 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:04:00.260885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:00.586713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11976): Launched 11:04:00.892667 run iperf3-srv_10.42.42.10(pid=11977): Launched 11:04:01.024779 tst iperf3.py:8: start network... 11:04:01.238095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:01.734651 run create_hlr_db(pid=11978): Launched 11:04:01.896728 bus /gobi_6: Setting Powered False 11:04:02.957473 run create_hlr_db(pid=11978): Terminated: ok {rc=0} 11:04:03.379130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11980): Launched 11:04:03.681361 run osmo-hlr_10.42.42.2(pid=11981): Launched 11:04:03.795378 run osmo-stp_10.42.42.5: Starting osmo-stp 11:04:04.339999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11983): Launched 11:04:04.640387 run osmo-stp_10.42.42.5(pid=11984): Launched 11:04:04.754102 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:04:05.272122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11986): Launched 11:04:05.389285 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:04:05.644202 run patchelf(pid=11987): Launched 11:04:05.811335 run osmo-stp_10.42.42.5(pid=11984): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11984)] 11:04:05.938778 run osmo-stp_10.42.42.5(pid=11984): stdout: | (launched: 2022-12-13_11:04:04.585124) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:06.067246 run osmo-stp_10.42.42.5(pid=11984): stderr: | 20221213110404759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110404759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110404759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110404759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110404760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110404760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110404760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:06.197073 run osmo-stp_10.42.42.5(pid=11984): stdout: | (launched: 2022-12-13_11:04:04.585124) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:06.320030 run osmo-stp_10.42.42.5(pid=11984): stderr: | 20221213110404759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110404759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110404759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110404759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110404760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110404760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110404760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:06.465453 run patchelf(pid=11987): Terminating (SIGINT) 11:04:06.634241 run patchelf(pid=11987): Terminated: ok {rc=0} 11:04:06.756294 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11984): Process ended prematurely: osmo-stp_10.42.42.5(pid=11984) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11984)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 11:04:06.765940 tst iperf3.py:8: Test FAILED (7.6 sec) 11:04:06.792647 run osmo-hlr_10.42.42.2(pid=11981): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11981)] 11:04:06.840162 run osmo-hlr_10.42.42.2(pid=11981): stdout: | (launched: 2022-12-13_11:04:03.625396) 11:04:06.889226 run osmo-hlr_10.42.42.2(pid=11981): stderr: | 20221213110403804 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110403804 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110403804 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110403804 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110403804 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110403804 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110403816 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110403825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110403825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110403825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:06.938746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11976): Terminating (SIGTERM) 11:04:06.978172 run iperf3-srv_10.42.42.10(pid=11977): Terminating (SIGTERM) 11:04:07.017523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11980): Terminating (SIGTERM) 11:04:07.056865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11983): Terminating (SIGTERM) 11:04:07.096177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11986): Terminating (SIGTERM) 11:04:07.135862 --- ParallelTerminationStrategy: PID 11976 died... 11:04:07.154954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11976): Terminated: ok {rc=0} 11:04:07.198432 --- ParallelTerminationStrategy: PID 11977 died... 11:04:07.216775 run iperf3-srv_10.42.42.10(pid=11977): Terminated {rc=256} 11:04:07.260405 --- ParallelTerminationStrategy: PID 11980 died... 11:04:07.278979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11980): Terminated: ok {rc=0} 11:04:07.322390 --- ParallelTerminationStrategy: PID 11983 died... 11:04:07.340785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11983): Terminated: ok {rc=0} 11:04:07.384204 --- ParallelTerminationStrategy: PID 11986 died... 11:04:07.402694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11986): Terminated: ok {rc=0} 11:04:07.485518 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:04:08.635770 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:08.648065 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:04:08.717090 tst iperf3m4.py: using LAC 33503 11:04:08.845383 tst iperf3m4.py: using RAC 98 11:04:08.972405 tst iperf3m4.py: using CellId 33503 11:04:09.100729 tst iperf3m4.py: using BVCI 33504 11:04:09.218588 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:09.230320 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:09.241796 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:09.253279 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:09.265366 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:09.277304 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:09.289419 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:09.301424 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:09.313598 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:09.431130 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:09.552940 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:09.669380 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:09.784860 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:04:09.986550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:10.288774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11988): Launched 11:04:10.551292 run iperf3-srv_10.42.42.10(pid=11989): Launched 11:04:10.664447 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:04:10.866185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:11.168909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11990): Launched 11:04:11.431684 run iperf3-srv_10.42.42.10(pid=11991): Launched 11:04:11.544644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:04:11.746509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:12.050119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11992): Launched 11:04:12.315816 run iperf3-srv_10.42.42.10(pid=11993): Launched 11:04:12.428784 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:04:12.630744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:12.934068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11994): Launched 11:04:13.196750 run iperf3-srv_10.42.42.10(pid=11995): Launched 11:04:13.309091 tst iperf3m4.py:8: start network... 11:04:13.509796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:13.974488 run create_hlr_db(pid=11996): Launched 11:04:14.097913 bus /gobi_6: Setting Powered False 11:04:15.158608 run create_hlr_db(pid=11996): Terminated: ok {rc=0} 11:04:15.598049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11998): Launched 11:04:15.936071 run osmo-hlr_10.42.42.2(pid=11999): Launched 11:04:16.152051 run osmo-stp_10.42.42.5: Starting osmo-stp 11:04:16.995956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12001): Launched 11:04:17.329873 run osmo-stp_10.42.42.5(pid=12002): Launched 11:04:17.549818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:04:18.069511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12004): Launched 11:04:18.184366 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:04:18.439430 run patchelf(pid=12005): Launched 11:04:18.606820 run osmo-stp_10.42.42.5(pid=12002): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12002)] 11:04:18.734418 run osmo-stp_10.42.42.5(pid=12002): stdout: | (launched: 2022-12-13_11:04:17.267360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:18.863059 run osmo-stp_10.42.42.5(pid=12002): stderr: | 20221213110417482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110417482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110417482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110417482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110417483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110417483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110417483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:18.991627 run osmo-stp_10.42.42.5(pid=12002): stdout: | (launched: 2022-12-13_11:04:17.267360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:19.114943 run osmo-stp_10.42.42.5(pid=12002): stderr: | 20221213110417482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110417482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110417482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110417482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110417483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110417483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110417483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:19.260937 run patchelf(pid=12005): Terminating (SIGINT) 11:04:19.430503 run patchelf(pid=12005): Terminated: ok {rc=0} 11:04:19.552651 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12002): Process ended prematurely: osmo-stp_10.42.42.5(pid=12002) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12002)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:04:19.562279 tst iperf3m4.py:8: Test FAILED (11.0 sec) 11:04:19.589345 run osmo-hlr_10.42.42.2(pid=11999): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11999)] 11:04:19.636907 run osmo-hlr_10.42.42.2(pid=11999): stdout: | (launched: 2022-12-13_11:04:15.869507) 11:04:19.686121 run osmo-hlr_10.42.42.2(pid=11999): stderr: | 20221213110416273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110416273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110416273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110416273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110416273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110416273 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110416296 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110416305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110416310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110416310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:19.735729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11988): Terminating (SIGTERM) 11:04:19.775310 run iperf3-srv_10.42.42.10(pid=11989): Terminating (SIGTERM) 11:04:19.814730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11990): Terminating (SIGTERM) 11:04:19.854376 run iperf3-srv_10.42.42.10(pid=11991): Terminating (SIGTERM) 11:04:19.893665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11992): Terminating (SIGTERM) 11:04:19.933146 run iperf3-srv_10.42.42.10(pid=11993): Terminating (SIGTERM) 11:04:19.972377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11994): Terminating (SIGTERM) 11:04:20.011908 run iperf3-srv_10.42.42.10(pid=11995): Terminating (SIGTERM) 11:04:20.051296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11998): Terminating (SIGTERM) 11:04:20.090862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12001): Terminating (SIGTERM) 11:04:20.130802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12004): Terminating (SIGTERM) 11:04:20.170431 --- ParallelTerminationStrategy: PID 11988 died... 11:04:20.189342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11988): Terminated: ok {rc=0} 11:04:20.233164 --- ParallelTerminationStrategy: PID 11989 died... 11:04:20.251533 run iperf3-srv_10.42.42.10(pid=11989): Terminated {rc=256} 11:04:20.295369 --- ParallelTerminationStrategy: PID 11990 died... 11:04:20.313897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11990): Terminated: ok {rc=0} 11:04:20.357133 --- ParallelTerminationStrategy: PID 11991 died... 11:04:20.375407 run iperf3-srv_10.42.42.10(pid=11991): Terminated {rc=256} 11:04:20.418712 --- ParallelTerminationStrategy: PID 11992 died... 11:04:20.437148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11992): Terminated: ok {rc=0} 11:04:20.480478 --- ParallelTerminationStrategy: PID 11993 died... 11:04:20.498862 run iperf3-srv_10.42.42.10(pid=11993): Terminated {rc=256} 11:04:20.542610 --- ParallelTerminationStrategy: PID 11994 died... 11:04:20.561267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11994): Terminated: ok {rc=0} 11:04:20.604674 --- ParallelTerminationStrategy: PID 11995 died... 11:04:20.623139 run iperf3-srv_10.42.42.10(pid=11995): Terminated {rc=256} 11:04:20.666413 --- ParallelTerminationStrategy: PID 11998 died... 11:04:20.684919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11998): Terminated: ok {rc=0} 11:04:20.728391 --- ParallelTerminationStrategy: PID 12001 died... 11:04:20.746979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12001): Terminated: ok {rc=0} 11:04:20.790642 --- ParallelTerminationStrategy: PID 12004 died... 11:04:20.809276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12004): Terminated: ok {rc=0} 11:04:20.895258 bus /gobi_4: Setting Powered False 11:04:21.995253 bus /gobi_4: Setting Powered False 11:04:23.107575 bus /gobi_1: Setting Powered False 11:04:24.205994 bus /gobi_1: Setting Powered False 11:04:25.320845 bus /gobi_0: Setting Powered False 11:04:26.419269 bus /gobi_0: Setting Powered False 11:04:27.535901 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:04:28.639056 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:28.651373 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:04:28.719065 tst ping.py: using LAC 33504 11:04:28.842681 tst ping.py: using RAC 99 11:04:28.965591 tst ping.py: using CellId 33504 11:04:29.097724 tst ping.py: using BVCI 33505 11:04:29.205906 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:29.217229 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:29.228076 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:29.239028 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:29.250577 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:29.262248 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:29.273870 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:29.285382 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:29.404901 tst ping.py:19: start network... 11:04:29.618931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:30.110047 run create_hlr_db(pid=12007): Launched 11:04:30.232768 bus /gobi_6: Setting Powered False 11:04:31.307582 run create_hlr_db(pid=12007): Terminated: ok {rc=0} 11:04:31.758908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12009): Launched 11:04:32.077475 run osmo-hlr_10.42.42.2(pid=12010): Launched 11:04:32.271204 run osmo-stp_10.42.42.5: Starting osmo-stp 11:04:32.790324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12012): Launched 11:04:33.086348 run osmo-stp_10.42.42.5(pid=12013): Launched 11:04:33.200138 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:04:33.726087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12015): Launched 11:04:33.838418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:04:34.087918 run patchelf(pid=12016): Launched 11:04:34.251226 run osmo-stp_10.42.42.5(pid=12013): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12013)] 11:04:34.376275 run osmo-stp_10.42.42.5(pid=12013): stdout: | (launched: 2022-12-13_11:04:33.031390) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:34.503609 run osmo-stp_10.42.42.5(pid=12013): stderr: | 20221213110433199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110433200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110433200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110433200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110433203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110433203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110433203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:34.629987 run osmo-stp_10.42.42.5(pid=12013): stdout: | (launched: 2022-12-13_11:04:33.031390) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:34.750778 run osmo-stp_10.42.42.5(pid=12013): stderr: | 20221213110433199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110433200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110433200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110433200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110433203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110433203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110433203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:34.894265 run patchelf(pid=12016): Terminating (SIGINT) 11:04:35.059749 run patchelf(pid=12016): Terminated: ok {rc=0} 11:04:35.179345 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12013): Process ended prematurely: osmo-stp_10.42.42.5(pid=12013) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12013)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 11:04:35.188189 tst ping.py:22: Test FAILED (6.5 sec) 11:04:35.214554 run osmo-hlr_10.42.42.2(pid=12010): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12010)] 11:04:35.262219 run osmo-hlr_10.42.42.2(pid=12010): stdout: | (launched: 2022-12-13_11:04:32.018082) 11:04:35.310997 run osmo-hlr_10.42.42.2(pid=12010): stderr: | 20221213110432260 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110432260 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110432260 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110432260 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110432260 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110432260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110432279 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110432287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110432287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110432287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:35.360162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12009): Terminating (SIGTERM) 11:04:35.399439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12012): Terminating (SIGTERM) 11:04:35.438747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12015): Terminating (SIGTERM) 11:04:35.478213 --- ParallelTerminationStrategy: PID 12009 died... 11:04:35.497411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12009): Terminated: ok {rc=0} 11:04:35.541039 --- ParallelTerminationStrategy: PID 12012 died... 11:04:35.559573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12012): Terminated: ok {rc=0} 11:04:35.602842 --- ParallelTerminationStrategy: PID 12015 died... 11:04:35.621261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12015): Terminated: ok {rc=0} 11:04:35.704264 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:04:36.789983 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:36.802298 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:04:36.873041 tst ping_idle_ping.py: using LAC 33505 11:04:36.999277 tst ping_idle_ping.py: using RAC 100 11:04:37.125047 tst ping_idle_ping.py: using CellId 33505 11:04:37.250698 tst ping_idle_ping.py: using BVCI 33506 11:04:37.365953 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:37.377464 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:37.388681 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:37.399976 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:37.411626 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:37.423337 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:37.435206 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:37.446997 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:37.566917 tst ping_idle_ping.py:24: start network... 11:04:37.781447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:38.275984 run create_hlr_db(pid=12017): Launched 11:04:38.397582 bus /gobi_6: Setting Powered False 11:04:39.460553 run create_hlr_db(pid=12017): Terminated: ok {rc=0} 11:04:39.905182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12019): Launched 11:04:40.223018 run osmo-hlr_10.42.42.2(pid=12020): Launched 11:04:40.346462 run osmo-stp_10.42.42.5: Starting osmo-stp 11:04:40.897757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12022): Launched 11:04:41.216816 run osmo-stp_10.42.42.5(pid=12023): Launched 11:04:41.338363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:04:41.889456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12025): Launched 11:04:42.010886 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:04:42.279956 run patchelf(pid=12026): Launched 11:04:42.456469 run osmo-stp_10.42.42.5(pid=12023): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12023)] 11:04:42.591800 run osmo-stp_10.42.42.5(pid=12023): stdout: | (launched: 2022-12-13_11:04:41.158605) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:42.729124 run osmo-stp_10.42.42.5(pid=12023): stderr: | 20221213110441351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110441351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110441352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110441352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110441352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110441353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110441353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:42.865537 run osmo-stp_10.42.42.5(pid=12023): stdout: | (launched: 2022-12-13_11:04:41.158605) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:42.996680 run osmo-stp_10.42.42.5(pid=12023): stderr: | 20221213110441351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110441351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110441352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110441352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110441352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110441353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110441353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:43.151501 run patchelf(pid=12026): Terminating (SIGINT) 11:04:43.330528 run patchelf(pid=12026): Terminated: ok {rc=0} 11:04:43.459364 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12023): Process ended prematurely: osmo-stp_10.42.42.5(pid=12023) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12023)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:04:43.469088 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:04:43.497051 run osmo-hlr_10.42.42.2(pid=12020): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12020)] 11:04:43.548007 run osmo-hlr_10.42.42.2(pid=12020): stdout: | (launched: 2022-12-13_11:04:40.164689) 11:04:43.600325 run osmo-hlr_10.42.42.2(pid=12020): stderr: | 20221213110440363 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110440363 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110440363 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110440363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110440363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110440363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110440375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110440384 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110440384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110440384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:43.653770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12019): Terminating (SIGTERM) 11:04:43.696088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12022): Terminating (SIGTERM) 11:04:43.738774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12025): Terminating (SIGTERM) 11:04:43.781375 --- ParallelTerminationStrategy: PID 12019 died... 11:04:43.801961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12019): Terminated: ok {rc=0} 11:04:43.848909 --- ParallelTerminationStrategy: PID 12022 died... 11:04:43.869166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12022): Terminated: ok {rc=0} 11:04:43.915438 --- ParallelTerminationStrategy: PID 12025 died... 11:04:43.935458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12025): Terminated: ok {rc=0} 11:04:44.023060 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:04:45.323214 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:04:45.329746 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:04:45.358773 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:04:45.397379 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:04:45.484046 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:04:45.514337 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:04:45.554599 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:04:46.150137 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:04:46.205806 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:04:46.217972 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:04:46.288559 tst cs_paging_gprs_active.py: using LAC 33506 11:04:46.420758 tst cs_paging_gprs_active.py: using RAC 101 11:04:46.603899 tst cs_paging_gprs_active.py: using CellId 33506 11:04:46.731654 tst cs_paging_gprs_active.py: using BVCI 33507 11:04:46.890313 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:04:46.906741 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:04:46.923300 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:04:46.940737 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:04:46.958564 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:04:46.975687 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:04:46.992113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:04:47.005071 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:04:47.022887 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:04:47.163036 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:04:47.284548 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:04:47.505866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:47.833416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12030): Launched 11:04:48.114730 run iperf3-srv_10.42.42.10(pid=12031): Launched 11:04:48.238097 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:04:48.458176 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:48.785634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12032): Launched 11:04:49.068547 run iperf3-srv_10.42.42.10(pid=12033): Launched 11:04:49.190872 tst cs_paging_gprs_active.py:38: start network... 11:04:49.410715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:49.915591 run create_hlr_db(pid=12034): Launched 11:04:50.040313 bus /gobi_6: Setting Powered False 11:04:51.104747 run create_hlr_db(pid=12034): Terminated: ok {rc=0} 11:04:51.556781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12036): Launched 11:04:51.881114 run osmo-hlr_10.42.42.2(pid=12037): Launched 11:04:52.006728 run osmo-stp_10.42.42.5: Starting osmo-stp 11:04:52.563735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12039): Launched 11:04:52.888420 run osmo-stp_10.42.42.5(pid=12040): Launched 11:04:53.014489 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:04:53.574530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12042): Launched 11:04:53.700899 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:04:53.983293 run patchelf(pid=12043): Launched 11:04:54.166267 run osmo-stp_10.42.42.5(pid=12040): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12040)] 11:04:54.304570 run osmo-stp_10.42.42.5(pid=12040): stdout: | (launched: 2022-12-13_11:04:52.829089) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:54.444333 run osmo-stp_10.42.42.5(pid=12040): stderr: | 20221213110453022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110453022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110453023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110453023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110453023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110453023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110453024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:54.583813 run osmo-stp_10.42.42.5(pid=12040): stdout: | (launched: 2022-12-13_11:04:52.829089) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:54.718382 run osmo-stp_10.42.42.5(pid=12040): stderr: | 20221213110453022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110453022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110453023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110453023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110453023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110453023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110453024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:54.877260 run patchelf(pid=12043): Terminating (SIGINT) 11:04:55.060625 run patchelf(pid=12043): Terminated: ok {rc=0} 11:04:55.193148 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12040): Process ended prematurely: osmo-stp_10.42.42.5(pid=12040) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12040)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:04:55.203478 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 11:04:55.232108 run osmo-hlr_10.42.42.2(pid=12037): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12037)] 11:04:55.283391 run osmo-hlr_10.42.42.2(pid=12037): stdout: | (launched: 2022-12-13_11:04:51.821668) 11:04:55.336175 run osmo-hlr_10.42.42.2(pid=12037): stderr: | 20221213110452019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110452019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110452019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110452019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110452019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110452019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110452033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110452041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110452041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110452042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:55.389257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12030): Terminating (SIGTERM) 11:04:55.431452 run iperf3-srv_10.42.42.10(pid=12031): Terminating (SIGTERM) 11:04:55.474132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12032): Terminating (SIGTERM) 11:04:55.516777 run iperf3-srv_10.42.42.10(pid=12033): Terminating (SIGTERM) 11:04:55.559415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12036): Terminating (SIGTERM) 11:04:55.602226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12039): Terminating (SIGTERM) 11:04:55.645112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12042): Terminating (SIGTERM) 11:04:55.688211 --- ParallelTerminationStrategy: PID 12030 died... 11:04:55.709107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12030): Terminated: ok {rc=0} 11:04:55.756107 --- ParallelTerminationStrategy: PID 12031 died... 11:04:55.776234 run iperf3-srv_10.42.42.10(pid=12031): Terminated {rc=256} 11:04:55.822883 --- ParallelTerminationStrategy: PID 12032 died... 11:04:55.843154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12032): Terminated: ok {rc=0} 11:04:55.890090 --- ParallelTerminationStrategy: PID 12033 died... 11:04:55.910401 run iperf3-srv_10.42.42.10(pid=12033): Terminated {rc=256} 11:04:55.957201 --- ParallelTerminationStrategy: PID 12036 died... 11:04:55.977408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12036): Terminated: ok {rc=0} 11:04:56.024261 --- ParallelTerminationStrategy: PID 12039 died... 11:04:56.044566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12039): Terminated: ok {rc=0} 11:04:56.091501 --- ParallelTerminationStrategy: PID 12042 died... 11:04:56.111818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12042): Terminated: ok {rc=0} 11:04:56.201191 bus /gobi_0: Setting Powered False 11:04:57.300362 bus /gobi_0: Setting Powered False 11:04:58.417397 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:04:59.567824 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:04:59.580148 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:04:59.648406 tst iperf3.py: using LAC 33507 11:04:59.774184 tst iperf3.py: using RAC 102 11:04:59.900171 tst iperf3.py: using CellId 33507 11:05:00.026258 tst iperf3.py: using BVCI 33508 11:05:00.143498 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:00.155139 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:00.166519 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:00.177866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:00.189471 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:00.200899 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:00.212608 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:00.224069 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:00.235726 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:05:00.354501 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:05:00.572798 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:05:00.901375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12044): Launched 11:05:01.205726 run iperf3-srv_10.42.42.10(pid=12045): Launched 11:05:01.340220 tst iperf3.py:8: start network... 11:05:01.563531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:02.082602 run create_hlr_db(pid=12049): Launched 11:05:02.240121 bus /gobi_6: Setting Powered False 11:05:03.303472 run create_hlr_db(pid=12049): Terminated: ok {rc=0} 11:05:03.737072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12051): Launched 11:05:04.039267 run osmo-hlr_10.42.42.2(pid=12052): Launched 11:05:04.154295 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:04.678585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12054): Launched 11:05:04.982263 run osmo-stp_10.42.42.5(pid=12055): Launched 11:05:05.097652 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:05:05.620633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12057): Launched 11:05:05.735734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:05:05.990975 run patchelf(pid=12058): Launched 11:05:06.158280 run osmo-stp_10.42.42.5(pid=12055): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12055)] 11:05:06.286043 run osmo-stp_10.42.42.5(pid=12055): stdout: | (launched: 2022-12-13_11:05:04.925702) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:06.415416 run osmo-stp_10.42.42.5(pid=12055): stderr: | 20221213110505096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110505096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110505097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110505097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110505099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110505099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110505100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:06.544531 run osmo-stp_10.42.42.5(pid=12055): stdout: | (launched: 2022-12-13_11:05:04.925702) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:06.669216 run osmo-stp_10.42.42.5(pid=12055): stderr: | 20221213110505096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110505096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110505097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110505097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110505099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110505099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110505100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:06.816092 run patchelf(pid=12058): Terminating (SIGINT) 11:05:06.986436 run patchelf(pid=12058): Terminated: ok {rc=0} 11:05:07.109261 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12055): Process ended prematurely: osmo-stp_10.42.42.5(pid=12055) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12055)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 11:05:07.120532 tst iperf3.py:8: Test FAILED (7.6 sec) 11:05:07.147751 run osmo-hlr_10.42.42.2(pid=12052): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12052)] 11:05:07.195489 run osmo-hlr_10.42.42.2(pid=12052): stdout: | (launched: 2022-12-13_11:05:03.983727) 11:05:07.244893 run osmo-hlr_10.42.42.2(pid=12052): stderr: | 20221213110504159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110504159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110504159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110504159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110504159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110504159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110504171 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110504180 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110504180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110504180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:07.295152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12044): Terminating (SIGTERM) 11:05:07.335008 run iperf3-srv_10.42.42.10(pid=12045): Terminating (SIGTERM) 11:05:07.375028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12051): Terminating (SIGTERM) 11:05:07.415137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12054): Terminating (SIGTERM) 11:05:07.455161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12057): Terminating (SIGTERM) 11:05:07.495587 --- ParallelTerminationStrategy: PID 12044 died... 11:05:07.514628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12044): Terminated: ok {rc=0} 11:05:07.558953 --- ParallelTerminationStrategy: PID 12045 died... 11:05:07.577871 run iperf3-srv_10.42.42.10(pid=12045): Terminated {rc=256} 11:05:07.622094 --- ParallelTerminationStrategy: PID 12051 died... 11:05:07.641419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12051): Terminated: ok {rc=0} 11:05:07.685691 --- ParallelTerminationStrategy: PID 12054 died... 11:05:07.704693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12054): Terminated: ok {rc=0} 11:05:07.749147 --- ParallelTerminationStrategy: PID 12057 died... 11:05:07.768009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12057): Terminated: ok {rc=0} 11:05:07.854297 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:05:09.003136 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:09.014956 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:05:09.081613 tst iperf3m4.py: using LAC 33508 11:05:09.207781 tst iperf3m4.py: using RAC 103 11:05:09.325496 tst iperf3m4.py: using CellId 33508 11:05:09.443868 tst iperf3m4.py: using BVCI 33509 11:05:09.552856 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:09.563937 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:09.574882 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:09.585701 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:09.596436 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:09.607173 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:09.618238 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:09.628813 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:09.639795 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:05:09.756331 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:05:09.877176 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:05:09.995992 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:05:10.114732 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:05:10.318293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:05:10.622036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12059): Launched 11:05:10.887787 run iperf3-srv_10.42.42.10(pid=12060): Launched 11:05:11.000747 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:05:11.203142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:05:11.506719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12061): Launched 11:05:11.769477 run iperf3-srv_10.42.42.10(pid=12062): Launched 11:05:11.882334 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:05:12.083748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:05:12.386945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12063): Launched 11:05:12.650660 run iperf3-srv_10.42.42.10(pid=12064): Launched 11:05:12.764262 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:05:12.966316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:05:13.269959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12065): Launched 11:05:13.532278 run iperf3-srv_10.42.42.10(pid=12066): Launched 11:05:13.645360 tst iperf3m4.py:8: start network... 11:05:13.847743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:14.316500 run create_hlr_db(pid=12067): Launched 11:05:14.439988 bus /gobi_6: Setting Powered False 11:05:15.501509 run create_hlr_db(pid=12067): Terminated: ok {rc=0} 11:05:15.961486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12069): Launched 11:05:16.313952 run osmo-hlr_10.42.42.2(pid=12070): Launched 11:05:16.631468 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:17.196151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12072): Launched 11:05:17.515726 run osmo-stp_10.42.42.5(pid=12073): Launched 11:05:17.649888 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:05:18.211748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12075): Launched 11:05:18.337682 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:05:18.611434 run patchelf(pid=12076): Launched 11:05:18.793358 run osmo-stp_10.42.42.5(pid=12073): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12073)] 11:05:18.930584 run osmo-stp_10.42.42.5(pid=12073): stdout: | (launched: 2022-12-13_11:05:17.458874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:19.069351 run osmo-stp_10.42.42.5(pid=12073): stderr: | 20221213110517658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110517658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110517658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110517659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110517659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110517659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110517659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:19.207649 run osmo-stp_10.42.42.5(pid=12073): stdout: | (launched: 2022-12-13_11:05:17.458874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:19.340762 run osmo-stp_10.42.42.5(pid=12073): stderr: | 20221213110517658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110517658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110517658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110517659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110517659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110517659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110517659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:19.498594 run patchelf(pid=12076): Terminating (SIGINT) 11:05:19.680779 run patchelf(pid=12076): Terminated: ok {rc=0} 11:05:19.812344 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12073): Process ended prematurely: osmo-stp_10.42.42.5(pid=12073) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12073)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:05:19.822635 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:05:19.851346 run osmo-hlr_10.42.42.2(pid=12070): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12070)] 11:05:19.902313 run osmo-hlr_10.42.42.2(pid=12070): stdout: | (launched: 2022-12-13_11:05:16.252600) 11:05:19.954683 run osmo-hlr_10.42.42.2(pid=12070): stderr: | 20221213110516455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110516455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110516455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110516455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110516455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110516455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110516469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110516492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110516492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110516493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:20.007402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12059): Terminating (SIGTERM) 11:05:20.049650 run iperf3-srv_10.42.42.10(pid=12060): Terminating (SIGTERM) 11:05:20.092420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12061): Terminating (SIGTERM) 11:05:20.134766 run iperf3-srv_10.42.42.10(pid=12062): Terminating (SIGTERM) 11:05:20.177186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12063): Terminating (SIGTERM) 11:05:20.219675 run iperf3-srv_10.42.42.10(pid=12064): Terminating (SIGTERM) 11:05:20.261796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12065): Terminating (SIGTERM) 11:05:20.304057 run iperf3-srv_10.42.42.10(pid=12066): Terminating (SIGTERM) 11:05:20.346262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12069): Terminating (SIGTERM) 11:05:20.388587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12072): Terminating (SIGTERM) 11:05:20.431260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12075): Terminating (SIGTERM) 11:05:20.474031 --- ParallelTerminationStrategy: PID 12059 died... 11:05:20.494499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12059): Terminated: ok {rc=0} 11:05:20.541473 --- ParallelTerminationStrategy: PID 12060 died... 11:05:20.561534 run iperf3-srv_10.42.42.10(pid=12060): Terminated {rc=256} 11:05:20.607989 --- ParallelTerminationStrategy: PID 12061 died... 11:05:20.628237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12061): Terminated: ok {rc=0} 11:05:20.675290 --- ParallelTerminationStrategy: PID 12062 died... 11:05:20.695521 run iperf3-srv_10.42.42.10(pid=12062): Terminated {rc=256} 11:05:20.742192 --- ParallelTerminationStrategy: PID 12063 died... 11:05:20.762578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12063): Terminated: ok {rc=0} 11:05:20.809367 --- ParallelTerminationStrategy: PID 12064 died... 11:05:20.829699 run iperf3-srv_10.42.42.10(pid=12064): Terminated {rc=256} 11:05:20.876331 --- ParallelTerminationStrategy: PID 12065 died... 11:05:20.896662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12065): Terminated: ok {rc=0} 11:05:20.943276 --- ParallelTerminationStrategy: PID 12066 died... 11:05:20.963505 run iperf3-srv_10.42.42.10(pid=12066): Terminated {rc=256} 11:05:21.010163 --- ParallelTerminationStrategy: PID 12069 died... 11:05:21.030407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12069): Terminated: ok {rc=0} 11:05:21.077271 --- ParallelTerminationStrategy: PID 12072 died... 11:05:21.097564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12072): Terminated: ok {rc=0} 11:05:21.144287 --- ParallelTerminationStrategy: PID 12075 died... 11:05:21.164619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12075): Terminated: ok {rc=0} 11:05:21.253994 bus /gobi_4: Setting Powered False 11:05:22.352276 bus /gobi_4: Setting Powered False 11:05:23.470528 bus /gobi_1: Setting Powered False 11:05:24.569491 bus /gobi_1: Setting Powered False 11:05:25.685732 bus /gobi_0: Setting Powered False 11:05:26.783871 bus /gobi_0: Setting Powered False 11:05:27.900127 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:05:29.003057 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:29.014946 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:05:29.081797 tst ping.py: using LAC 33509 11:05:29.200515 tst ping.py: using RAC 104 11:05:29.318700 tst ping.py: using CellId 33509 11:05:29.436876 tst ping.py: using BVCI 33510 11:05:29.544310 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:29.555365 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:29.566299 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:29.577090 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:29.587896 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:29.598753 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:29.609682 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:29.620360 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:05:29.734345 tst ping.py:19: start network... 11:05:29.931213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:30.388688 run create_hlr_db(pid=12077): Launched 11:05:30.509112 bus /gobi_6: Setting Powered False 11:05:31.567702 run create_hlr_db(pid=12077): Terminated: ok {rc=0} 11:05:31.992340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12079): Launched 11:05:32.306398 run osmo-hlr_10.42.42.2(pid=12080): Launched 11:05:32.421799 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:32.947988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12082): Launched 11:05:33.243421 run osmo-stp_10.42.42.5(pid=12083): Launched 11:05:33.355775 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:05:33.867584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12085): Launched 11:05:33.980227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:05:34.230578 run patchelf(pid=12086): Launched 11:05:34.396517 run osmo-stp_10.42.42.5(pid=12083): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12083)] 11:05:34.521839 run osmo-stp_10.42.42.5(pid=12083): stdout: | (launched: 2022-12-13_11:05:33.188588) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:34.648923 run osmo-stp_10.42.42.5(pid=12083): stderr: | 20221213110533360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110533360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110533360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110533361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110533361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110533361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110533361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:34.776091 run osmo-stp_10.42.42.5(pid=12083): stdout: | (launched: 2022-12-13_11:05:33.188588) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:34.898333 run osmo-stp_10.42.42.5(pid=12083): stderr: | 20221213110533360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110533360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110533360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110533361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110533361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110533361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110533361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:35.041896 run patchelf(pid=12086): Terminating (SIGINT) 11:05:35.208241 run patchelf(pid=12086): Terminated: ok {rc=0} 11:05:35.328191 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12083): Process ended prematurely: osmo-stp_10.42.42.5(pid=12083) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12083)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 11:05:35.337189 tst ping.py:22: Test FAILED (6.3 sec) 11:05:35.363559 run osmo-hlr_10.42.42.2(pid=12080): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12080)] 11:05:35.410777 run osmo-hlr_10.42.42.2(pid=12080): stdout: | (launched: 2022-12-13_11:05:32.251246) 11:05:35.459852 run osmo-hlr_10.42.42.2(pid=12080): stderr: | 20221213110532427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110532427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110532427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110532427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110532427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110532428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110532439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110532448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110532448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110532448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:35.509374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12079): Terminating (SIGTERM) 11:05:35.548849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12082): Terminating (SIGTERM) 11:05:35.588414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12085): Terminating (SIGTERM) 11:05:35.628342 --- ParallelTerminationStrategy: PID 12079 died... 11:05:35.647847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12079): Terminated: ok {rc=0} 11:05:35.691734 --- ParallelTerminationStrategy: PID 12082 died... 11:05:35.710201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12082): Terminated: ok {rc=0} 11:05:35.753728 --- ParallelTerminationStrategy: PID 12085 died... 11:05:35.772423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12085): Terminated: ok {rc=0} 11:05:35.857606 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:05:36.946639 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:36.958916 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:05:37.026466 tst ping_idle_ping.py: using LAC 33510 11:05:37.144664 tst ping_idle_ping.py: using RAC 105 11:05:37.261209 tst ping_idle_ping.py: using CellId 33510 11:05:37.377646 tst ping_idle_ping.py: using BVCI 33511 11:05:37.485079 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:37.496107 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:37.506894 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:37.517810 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:37.528529 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:37.539443 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:37.550307 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:05:37.561191 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:05:37.680904 tst ping_idle_ping.py:24: start network... 11:05:37.895905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:38.392073 run create_hlr_db(pid=12087): Launched 11:05:38.513731 bus /gobi_6: Setting Powered False 11:05:39.577185 run create_hlr_db(pid=12087): Terminated: ok {rc=0} 11:05:40.006158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12089): Launched 11:05:40.303474 run osmo-hlr_10.42.42.2(pid=12090): Launched 11:05:40.417797 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:40.929656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12092): Launched 11:05:41.226760 run osmo-stp_10.42.42.5(pid=12093): Launched 11:05:41.339325 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:05:41.852018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12095): Launched 11:05:41.968737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:05:42.220296 run patchelf(pid=12096): Launched 11:05:42.385154 run osmo-stp_10.42.42.5(pid=12093): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12093)] 11:05:42.511444 run osmo-stp_10.42.42.5(pid=12093): stdout: | (launched: 2022-12-13_11:05:41.171358) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:42.638561 run osmo-stp_10.42.42.5(pid=12093): stderr: | 20221213110541342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110541342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110541342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110541343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110541343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110541343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110541343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:42.766119 run osmo-stp_10.42.42.5(pid=12093): stdout: | (launched: 2022-12-13_11:05:41.171358) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:42.887896 run osmo-stp_10.42.42.5(pid=12093): stderr: | 20221213110541342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110541342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110541342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110541343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110541343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110541343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110541343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:43.034559 run patchelf(pid=12096): Terminating (SIGINT) 11:05:43.202224 run patchelf(pid=12096): Terminated: ok {rc=0} 11:05:43.322625 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12093): Process ended prematurely: osmo-stp_10.42.42.5(pid=12093) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12093)] [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:05:43.331727 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 11:05:43.358547 run osmo-hlr_10.42.42.2(pid=12090): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12090)] 11:05:43.406440 run osmo-hlr_10.42.42.2(pid=12090): stdout: | (launched: 2022-12-13_11:05:40.248549) 11:05:43.456063 run osmo-hlr_10.42.42.2(pid=12090): stderr: | 20221213110540422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110540422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110540422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110540422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110540422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110540422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110540437 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110540447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110540447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110540447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:43.506143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12089): Terminating (SIGTERM) 11:05:43.545727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12092): Terminating (SIGTERM) 11:05:43.585432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12095): Terminating (SIGTERM) 11:05:43.625315 --- ParallelTerminationStrategy: PID 12089 died... 11:05:43.644623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12089): Terminated: ok {rc=0} 11:05:43.688408 --- ParallelTerminationStrategy: PID 12092 died... 11:05:43.707137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12092): Terminated: ok {rc=0} 11:05:43.750466 --- ParallelTerminationStrategy: PID 12095 died... 11:05:43.769016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12095): Terminated: ok {rc=0} 11:05:43.851490 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:05:45.154462 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:05:45.162241 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:05:45.192279 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:05:45.228848 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:05:45.283416 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:05:45.313271 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:05:45.348728 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:05:45.931224 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:05:45.937910 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:05:45.954489 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:05:46.032514 tst switch_tch_pdch.py: using LAC 33511 11:05:46.154033 tst switch_tch_pdch.py: using RAC 106 11:05:46.275673 tst switch_tch_pdch.py: using CellId 33511 11:05:46.393314 tst switch_tch_pdch.py: using BVCI 33512 11:05:46.503441 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:05:46.515548 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:05:46.527756 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:05:46.540161 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:05:46.552391 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:05:46.564007 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:05:46.575820 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:05:46.587606 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:05:46.720858 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:05:46.863181 tst switch_tch_pdch.py:51: start network... 11:05:47.102290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:47.568070 run create_hlr_db(pid=12100): Launched 11:05:47.690221 bus /gobi_6: Setting Powered False 11:05:48.749678 run create_hlr_db(pid=12100): Terminated: ok {rc=0} 11:05:49.164284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12102): Launched 11:05:49.461100 run osmo-hlr_10.42.42.2(pid=12103): Launched 11:05:49.573082 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:50.097629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12105): Launched 11:05:50.393086 run osmo-stp_10.42.42.5(pid=12106): Launched 11:05:50.505146 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:05:51.016165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12108): Launched 11:05:51.129075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:05:51.379498 run patchelf(pid=12109): Launched 11:05:51.543408 run osmo-stp_10.42.42.5(pid=12106): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12106)] 11:05:51.668323 run osmo-stp_10.42.42.5(pid=12106): stdout: | (launched: 2022-12-13_11:05:50.338332) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:51.795014 run osmo-stp_10.42.42.5(pid=12106): stderr: | 20221213110550508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110550508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110550509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110550509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110550511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110550511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110550511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:51.924282 run osmo-stp_10.42.42.5(pid=12106): stdout: | (launched: 2022-12-13_11:05:50.338332) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:52.045727 run osmo-stp_10.42.42.5(pid=12106): stderr: | 20221213110550508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110550508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110550509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110550509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110550511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110550511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110550511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:52.189539 run patchelf(pid=12109): Terminating (SIGINT) 11:05:52.355372 run patchelf(pid=12109): Terminated: ok {rc=0} 11:05:52.475212 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12106): Process ended prematurely: osmo-stp_10.42.42.5(pid=12106) [trial-2388↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12106)] [trial-2388↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:05:52.484129 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 11:05:52.510715 run osmo-hlr_10.42.42.2(pid=12103): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12103)] 11:05:52.558220 run osmo-hlr_10.42.42.2(pid=12103): stdout: | (launched: 2022-12-13_11:05:49.405382) 11:05:52.607596 run osmo-hlr_10.42.42.2(pid=12103): stderr: | 20221213110549583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110549583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110549583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110549583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110549583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110549584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110549596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110549606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110549606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110549606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:52.657215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12102): Terminating (SIGTERM) 11:05:52.696811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12105): Terminating (SIGTERM) 11:05:52.736467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12108): Terminating (SIGTERM) 11:05:52.776362 --- ParallelTerminationStrategy: PID 12102 died... 11:05:52.795632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12102): Terminated: ok {rc=0} 11:05:52.839536 --- ParallelTerminationStrategy: PID 12105 died... 11:05:52.858262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12105): Terminated: ok {rc=0} 11:05:52.901847 --- ParallelTerminationStrategy: PID 12108 died... 11:05:52.920434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12108): Terminated: ok {rc=0} 11:05:53.005667 bus /gobi_0: Setting Powered False 11:05:54.105119 bus /gobi_0: Setting Powered False 11:05:55.221388 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:05:56.478925 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:05:56.485259 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:05:56.514695 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:05:56.550902 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:05:56.606885 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:05:56.636745 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:05:56.672223 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:05:57.226851 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:05:57.232520 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:05:57.244217 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:05:57.313240 tst switch_tch_pdch.py: using LAC 33512 11:05:57.437582 tst switch_tch_pdch.py: using RAC 107 11:05:57.555622 tst switch_tch_pdch.py: using CellId 33512 11:05:57.673591 tst switch_tch_pdch.py: using BVCI 33513 11:05:57.780478 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:05:57.791560 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:05:57.802586 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:05:57.813500 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:05:57.824276 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:05:57.835153 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:05:57.846109 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:05:57.857528 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:05:57.972911 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:05:58.092382 tst switch_tch_pdch.py:51: start network... 11:05:58.306223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:58.771727 run create_hlr_db(pid=12117): Launched 11:05:58.893074 bus /gobi_6: Setting Powered False 11:05:59.956018 run create_hlr_db(pid=12117): Terminated: ok {rc=0} 11:06:00.355678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12119): Launched 11:06:00.651467 run osmo-hlr_10.42.42.2(pid=12120): Launched 11:06:00.765996 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:01.366753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12122): Launched 11:06:01.702309 run osmo-stp_10.42.42.5(pid=12123): Launched 11:06:01.847901 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:06:02.604333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12125): Launched 11:06:02.727901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:06:02.996328 run patchelf(pid=12126): Launched 11:06:03.173187 run osmo-stp_10.42.42.5(pid=12123): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12123)] 11:06:03.308065 run osmo-stp_10.42.42.5(pid=12123): stdout: | (launched: 2022-12-13_11:06:01.641217) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:03.444695 run osmo-stp_10.42.42.5(pid=12123): stderr: | 20221213110602031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110602031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110602031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110602032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110602032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110602032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110602032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:03.581199 run osmo-stp_10.42.42.5(pid=12123): stdout: | (launched: 2022-12-13_11:06:01.641217) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:03.711893 run osmo-stp_10.42.42.5(pid=12123): stderr: | 20221213110602031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110602031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110602031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110602032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110602032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110602032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110602032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:03.866827 run patchelf(pid=12126): Terminating (SIGINT) 11:06:04.045454 run patchelf(pid=12126): Terminated: ok {rc=0} 11:06:04.174124 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12123): Process ended prematurely: osmo-stp_10.42.42.5(pid=12123) [trial-2388↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12123)] [trial-2388↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:06:04.183767 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 11:06:04.211655 run osmo-hlr_10.42.42.2(pid=12120): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12120)] 11:06:04.262700 run osmo-hlr_10.42.42.2(pid=12120): stdout: | (launched: 2022-12-13_11:06:00.596835) 11:06:04.315118 run osmo-hlr_10.42.42.2(pid=12120): stderr: | 20221213110600773 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110600773 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110600773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110600773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110600773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110600773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110600785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110600794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110600794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110600794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:04.367667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12119): Terminating (SIGTERM) 11:06:04.409668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12122): Terminating (SIGTERM) 11:06:04.452377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12125): Terminating (SIGTERM) 11:06:04.495254 --- ParallelTerminationStrategy: PID 12119 died... 11:06:04.515490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12119): Terminated: ok {rc=0} 11:06:04.562100 --- ParallelTerminationStrategy: PID 12122 died... 11:06:04.581976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12122): Terminated: ok {rc=0} 11:06:04.628417 --- ParallelTerminationStrategy: PID 12125 died... 11:06:04.648444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12125): Terminated: ok {rc=0} 11:06:04.737919 bus /gobi_0: Setting Powered False 11:06:05.836680 bus /gobi_0: Setting Powered False 11:06:06.953970 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_sms:nanobts --------------------------------------------------------------------- 11:06:08.208468 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:08.213566 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 11:06:08.238376 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 11:06:08.245609 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 11:06:08.298578 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 11:06:08.321956 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 11:06:08.328710 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 11:06:08.866228 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 11:06:08.871455 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 11:06:08.882309 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 11:06:08.919474 tst mo_mt_sms.py: using LAC 33513 11:06:09.037376 tst mo_mt_sms.py: using RAC 108 11:06:09.153696 tst mo_mt_sms.py: using CellId 33513 11:06:09.277405 tst mo_mt_sms.py: using BVCI 33514 11:06:09.392310 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 11:06:09.509403 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 11:06:09.623806 tst mo_mt_sms.py:9: start nitb and bts... 11:06:09.822270 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:06:10.428045 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12130): Launched 11:06:10.724018 run osmo-nitb_10.42.42.2(pid=12131): Launched 11:06:10.887571 run osmo-nitb_10.42.42.2(pid=12131): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12131)] 11:06:11.019788 run osmo-nitb_10.42.42.2(pid=12131): stdout: | (launched: 2022-12-13_11:06:10.669554) 11:06:11.154934 run osmo-nitb_10.42.42.2(pid=12131): stderr: | (launched: 2022-12-13_11:06:10.713399) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:06:11.288774 run osmo-nitb_10.42.42.2(pid=12131): stdout: | (launched: 2022-12-13_11:06:10.669554) 11:06:11.417073 run osmo-nitb_10.42.42.2(pid=12131): stderr: | (launched: 2022-12-13_11:06:10.713399) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12131): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12131) [trial-2388↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12131)] 11:06:11.836076 tst osmo-nitb_10.42.42.2(pid=12131): stdout: | (launched: 2022-12-13_11:06:10.669554) 11:06:11.955355 tst osmo-nitb_10.42.42.2(pid=12131): stderr: | (launched: 2022-12-13_11:06:10.713399) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:06:12.096152 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12131): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12131) [trial-2388↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12131)] [trial-2388↪nitb_sms:nanobts↪mo_mt_sms.py:11] 11:06:12.104422 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 11:06:12.110950 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12130): Terminating (SIGTERM) 11:06:12.318850 --- ParallelTerminationStrategy: PID 12130 died... 11:06:12.339612 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12130): Terminated: ok {rc=0} 11:06:12.424629 bus /sierra_3: Setting Powered False 11:06:13.523605 bus /sierra_3: Setting Powered False 11:06:14.637407 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 sms:nanobts+band-1900 --------------------------------------------------------------------- 11:06:15.820648 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:15.826293 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 11:06:15.850646 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 11:06:15.887642 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 11:06:15.943529 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 11:06:15.968906 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 11:06:15.998680 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 11:06:16.540718 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 11:06:16.546942 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:06:16.559190 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 11:06:16.599961 tst mo_mt_sms.py: using LAC 33514 11:06:16.719676 tst mo_mt_sms.py: using RAC 109 11:06:16.845191 tst mo_mt_sms.py: using CellId 33514 11:06:16.964206 tst mo_mt_sms.py: using BVCI 33515 11:06:17.086205 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:06:17.098059 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:06:17.109856 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:06:17.121471 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:06:17.133984 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:06:17.146491 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 11:06:17.277328 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 11:06:17.392176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:17.851821 run create_hlr_db(pid=12135): Launched 11:06:17.972473 bus /sierra_2: Setting Powered False 11:06:19.032487 run create_hlr_db(pid=12135): Terminated: ok {rc=0} 11:06:19.467865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12137): Launched 11:06:19.786399 run osmo-hlr_10.42.42.2(pid=12138): Launched 11:06:19.908026 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:20.457386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12140): Launched 11:06:20.775891 run osmo-stp_10.42.42.5(pid=12141): Launched 11:06:20.897088 run osmo-msc_10.42.42.6: Starting osmo-msc 11:06:21.473166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12143): Launched 11:06:21.792556 run osmo-msc_10.42.42.6(pid=12144): Launched 11:06:21.970514 run osmo-stp_10.42.42.5(pid=12141): ERR: Terminated: ERROR {rc=1} [trial-2388↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12141)] 11:06:22.104814 run osmo-stp_10.42.42.5(pid=12141): stdout: | (launched: 2022-12-13_11:06:20.717204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:22.240383 run osmo-stp_10.42.42.5(pid=12141): stderr: | 20221213110620915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110620915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110620916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110620916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110620916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110620916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110620917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:22.375444 run osmo-stp_10.42.42.5(pid=12141): stdout: | (launched: 2022-12-13_11:06:20.717204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:22.502945 run osmo-stp_10.42.42.5(pid=12141): stderr: | 20221213110620915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110620915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110620916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110620916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110620916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110620916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110620917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:22.654985 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12141): Process ended prematurely: osmo-stp_10.42.42.5(pid=12141) [trial-2388↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12141)] [trial-2388↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 11:06:22.664089 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 11:06:22.691726 run osmo-hlr_10.42.42.2(pid=12138): ERR: Terminated: ERROR {rc=237} [trial-2388↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12138)] 11:06:22.742650 run osmo-hlr_10.42.42.2(pid=12138): stdout: | (launched: 2022-12-13_11:06:19.728147) 11:06:22.795650 run osmo-hlr_10.42.42.2(pid=12138): stderr: | 20221213110619925 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110619925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110619925 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110619925 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110619925 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110619926 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110619938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110619946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110619946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110619946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:22.868319 run osmo-msc_10.42.42.6(pid=12144): ERR: Terminated: ERROR {rc=2} [trial-2388↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12144)] 11:06:22.918274 run osmo-msc_10.42.42.6(pid=12144): stdout: | (launched: 2022-12-13_11:06:21.733632) 11:06:22.970489 run osmo-msc_10.42.42.6(pid=12144): stderr: | 20221213110622054 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110622054 DLGLOBAL DEBUG validating counter group 0x7f86ba93dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110622054 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110622054 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110622054 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110622054 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110622056 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110622057 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110622057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110622057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:06:23.022579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12137): Terminating (SIGTERM) 11:06:23.064611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12140): Terminating (SIGTERM) 11:06:23.106571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12143): Terminating (SIGTERM) 11:06:23.148865 --- ParallelTerminationStrategy: PID 12137 died... 11:06:23.169456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12137): Terminated: ok {rc=0} 11:06:23.215753 --- ParallelTerminationStrategy: PID 12140 died... 11:06:23.235773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12140): Terminated: ok {rc=0} 11:06:23.282306 --- ParallelTerminationStrategy: PID 12143 died... 11:06:23.302228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12143): Terminated: ok {rc=0} 11:06:23.390668 bus /sierra_3: Setting Powered False 11:06:24.489989 bus /sierra_3: Setting Powered False 11:06:25.606044 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 11:06:26.830050 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:26.835437 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 11:06:26.859688 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 11:06:26.866733 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 11:06:26.903824 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 11:06:26.928100 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 11:06:26.934956 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 11:06:27.454813 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2388 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 11:06:27.460280 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 11:06:27.471661 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 11:06:27.510682 tst assert_extension.py: using LAC 33515 11:06:27.635172 tst assert_extension.py: using RAC 110 11:06:27.759595 tst assert_extension.py: using CellId 33515 11:06:27.885179 tst assert_extension.py: using BVCI 33516 11:06:28.000392 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 11:06:28.115552 tst assert_extension.py:10: start nitb and bts... 11:06:28.313502 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:06:28.918918 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12149): Launched 11:06:29.216497 run osmo-nitb_10.42.42.2(pid=12150): Launched 11:06:29.382057 run osmo-nitb_10.42.42.2(pid=12150): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12150)] 11:06:29.515262 run osmo-nitb_10.42.42.2(pid=12150): stdout: | (launched: 2022-12-13_11:06:29.161659) 11:06:29.650545 run osmo-nitb_10.42.42.2(pid=12150): stderr: | (launched: 2022-12-13_11:06:29.205942) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:06:29.785571 run osmo-nitb_10.42.42.2(pid=12150): stdout: | (launched: 2022-12-13_11:06:29.161659) 11:06:29.914942 run osmo-nitb_10.42.42.2(pid=12150): stderr: | (launched: 2022-12-13_11:06:29.205942) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12150): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12150) [trial-2388↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12150)] 11:06:30.329381 tst osmo-nitb_10.42.42.2(pid=12150): stdout: | (launched: 2022-12-13_11:06:29.161659) 11:06:30.449122 tst osmo-nitb_10.42.42.2(pid=12150): stderr: | (launched: 2022-12-13_11:06:29.205942) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:06:30.590751 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12150): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12150) [trial-2388↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12150)] [trial-2388↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 11:06:30.598934 tst assert_extension.py:12: Test FAILED (3.1 sec) 11:06:30.605360 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12149): Terminating (SIGTERM) 11:06:30.813761 --- ParallelTerminationStrategy: PID 12149 died... 11:06:30.835153 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12149): Terminated: ok {rc=0} 11:06:30.939845 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 ussd:nanobts+band-1900 --------------------------------------------------------------------- 11:06:32.133409 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:32.143762 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 11:06:32.183616 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 11:06:32.210438 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 11:06:32.246412 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 11:06:32.270599 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 11:06:32.297695 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 11:06:32.826375 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2388 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 11:06:32.832650 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:06:32.844638 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 11:06:32.884689 tst assert_extension.py: using LAC 33516 11:06:33.010767 tst assert_extension.py: using RAC 111 11:06:33.136941 tst assert_extension.py: using CellId 33516 11:06:33.262067 tst assert_extension.py: using BVCI 33517 11:06:33.379995 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:06:33.391181 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:06:33.402263 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:06:33.413230 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:06:33.424437 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:06:33.435676 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 11:06:33.551537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:34.010995 run create_hlr_db(pid=12154): Launched 11:06:34.132330 bus /sierra_2: Setting Powered False 11:06:35.192225 run create_hlr_db(pid=12154): Terminated: ok {rc=0} 11:06:35.628079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12156): Launched 11:06:35.947817 run osmo-hlr_10.42.42.2(pid=12157): Launched 11:06:36.069254 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:36.622773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12159): Launched 11:06:36.943432 run osmo-stp_10.42.42.5(pid=12160): Launched 11:06:37.066212 run osmo-msc_10.42.42.6: Starting osmo-msc 11:06:37.641788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12162): Launched 11:06:37.959950 run osmo-msc_10.42.42.6(pid=12163): Launched 11:06:38.137438 run osmo-stp_10.42.42.5(pid=12160): ERR: Terminated: ERROR {rc=1} [trial-2388↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12160)] 11:06:38.272029 run osmo-stp_10.42.42.5(pid=12160): stdout: | (launched: 2022-12-13_11:06:36.884587) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:38.407541 run osmo-stp_10.42.42.5(pid=12160): stderr: | 20221213110637076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110637076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110637076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110637076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110637077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110637077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110637077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:38.542852 run osmo-stp_10.42.42.5(pid=12160): stdout: | (launched: 2022-12-13_11:06:36.884587) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:38.670046 run osmo-stp_10.42.42.5(pid=12160): stderr: | 20221213110637076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110637076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110637076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110637076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110637077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110637077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110637077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:38.822667 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12160): Process ended prematurely: osmo-stp_10.42.42.5(pid=12160) [trial-2388↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12160)] [trial-2388↪ussd:nanobts+band-1900↪assert_extension.py:17] 11:06:38.831606 tst assert_extension.py:17: Test FAILED (6.0 sec) 11:06:38.858999 run osmo-hlr_10.42.42.2(pid=12157): ERR: Terminated: ERROR {rc=237} [trial-2388↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12157)] 11:06:38.910019 run osmo-hlr_10.42.42.2(pid=12157): stdout: | (launched: 2022-12-13_11:06:35.889574) 11:06:38.962400 run osmo-hlr_10.42.42.2(pid=12157): stderr: | 20221213110636086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110636086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110636086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110636086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110636086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110636086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110636099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110636107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110636107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110636107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:39.035207 run osmo-msc_10.42.42.6(pid=12163): ERR: Terminated: ERROR {rc=2} [trial-2388↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12163)] 11:06:39.085809 run osmo-msc_10.42.42.6(pid=12163): stdout: | (launched: 2022-12-13_11:06:37.901546) 11:06:39.138260 run osmo-msc_10.42.42.6(pid=12163): stderr: | 20221213110638221 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110638221 DLGLOBAL DEBUG validating counter group 0x7f6aac141c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110638221 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110638221 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110638221 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110638222 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110638223 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110638224 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110638224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110638224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:06:39.190831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12156): Terminating (SIGTERM) 11:06:39.232765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12159): Terminating (SIGTERM) 11:06:39.275554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12162): Terminating (SIGTERM) 11:06:39.318061 --- ParallelTerminationStrategy: PID 12156 died... 11:06:39.338698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12156): Terminated: ok {rc=0} 11:06:39.385512 --- ParallelTerminationStrategy: PID 12159 died... 11:06:39.405615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12159): Terminated: ok {rc=0} 11:06:39.451883 --- ParallelTerminationStrategy: PID 12162 died... 11:06:39.471948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12162): Terminated: ok {rc=0} 11:06:39.559943 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:06:40.763238 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:40.771907 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:06:40.795775 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:06:40.822712 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:06:40.874596 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:06:40.899681 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:06:40.927431 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:06:41.475554 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:06:41.530990 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:06:41.542801 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:06:41.603540 tst mo_mt_call.py: using LAC 33517 11:06:41.730436 tst mo_mt_call.py: using RAC 112 11:06:41.858061 tst mo_mt_call.py: using CellId 33517 11:06:41.985400 tst mo_mt_call.py: using BVCI 33518 11:06:42.105178 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:06:42.116776 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:06:42.128277 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:06:42.139742 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:06:42.151757 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:06:42.163462 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:06:42.281342 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:06:42.398613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:42.865999 run create_hlr_db(pid=12169): Launched 11:06:42.990828 bus /sierra_2: Setting Powered False 11:06:44.051688 run create_hlr_db(pid=12169): Terminated: ok {rc=0} 11:06:44.473038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12171): Launched 11:06:44.775020 run osmo-hlr_10.42.42.2(pid=12172): Launched 11:06:44.890145 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:45.407364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12174): Launched 11:06:45.710650 run osmo-stp_10.42.42.5(pid=12175): Launched 11:06:45.825169 run osmo-msc_10.42.42.6: Starting osmo-msc 11:06:46.451617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12177): Launched 11:06:46.778617 run osmo-msc_10.42.42.6(pid=12178): Launched 11:06:47.120568 run osmo-stp_10.42.42.5(pid=12175): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12175)] 11:06:47.323528 run osmo-stp_10.42.42.5(pid=12175): stdout: | (launched: 2022-12-13_11:06:45.655096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:47.462032 run osmo-stp_10.42.42.5(pid=12175): stderr: | 20221213110645826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110645827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110645827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110645827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110645828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110645828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110645828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:47.599116 run osmo-stp_10.42.42.5(pid=12175): stdout: | (launched: 2022-12-13_11:06:45.655096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:47.728613 run osmo-stp_10.42.42.5(pid=12175): stderr: | 20221213110645826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110645827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110645827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110645827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110645828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110645828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110645828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:47.883744 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12175): Process ended prematurely: osmo-stp_10.42.42.5(pid=12175) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12175)] [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:06:47.893565 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:06:47.921506 run osmo-hlr_10.42.42.2(pid=12172): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12172)] 11:06:47.972826 run osmo-hlr_10.42.42.2(pid=12172): stdout: | (launched: 2022-12-13_11:06:44.719274) 11:06:48.025411 run osmo-hlr_10.42.42.2(pid=12172): stderr: | 20221213110644894 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110644894 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110644894 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110644894 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110644894 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110644894 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110644906 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110644915 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110644915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110644915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:48.098683 run osmo-msc_10.42.42.6(pid=12178): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12178)] 11:06:48.148823 run osmo-msc_10.42.42.6(pid=12178): stdout: | (launched: 2022-12-13_11:06:46.719034) 11:06:48.201702 run osmo-msc_10.42.42.6(pid=12178): stderr: | 20221213110647320 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110647320 DLGLOBAL DEBUG validating counter group 0x7fa33d3d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110647321 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110647321 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110647321 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110647321 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110647323 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110647323 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110647323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110647323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:06:48.254296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12171): Terminating (SIGTERM) 11:06:48.296208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12174): Terminating (SIGTERM) 11:06:48.338760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12177): Terminating (SIGTERM) 11:06:48.381403 --- ParallelTerminationStrategy: PID 12171 died... 11:06:48.402199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12171): Terminated: ok {rc=0} 11:06:48.449099 --- ParallelTerminationStrategy: PID 12174 died... 11:06:48.469288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12174): Terminated: ok {rc=0} 11:06:48.515986 --- ParallelTerminationStrategy: PID 12177 died... 11:06:48.536088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12177): Terminated: ok {rc=0} 11:06:48.625852 bus /sierra_3: Setting Powered False 11:06:49.725611 bus /sierra_3: Setting Powered False 11:06:50.842484 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:06:51.992590 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:06:52.005110 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:06:52.067272 tst mo_mt_call_osmux.py: using LAC 33518 11:06:52.195497 tst mo_mt_call_osmux.py: using RAC 113 11:06:52.323898 tst mo_mt_call_osmux.py: using CellId 33518 11:06:52.450501 tst mo_mt_call_osmux.py: using BVCI 33519 11:06:52.570357 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:06:52.582214 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:06:52.593882 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:06:52.605482 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:06:52.617719 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:06:52.629851 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:06:52.747155 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:06:52.870745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:53.340893 run create_hlr_db(pid=12180): Launched 11:06:53.466636 bus /sierra_2: Setting Powered False 11:06:54.526876 run create_hlr_db(pid=12180): Terminated: ok {rc=0} 11:06:54.971537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12182): Launched 11:06:55.297256 run osmo-hlr_10.42.42.2(pid=12183): Launched 11:06:55.423115 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:55.984358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12185): Launched 11:06:56.309188 run osmo-stp_10.42.42.5(pid=12186): Launched 11:06:56.434309 run osmo-msc_10.42.42.6: Starting osmo-msc 11:06:57.020921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12188): Launched 11:06:57.345982 run osmo-msc_10.42.42.6(pid=12189): Launched 11:06:57.526227 run osmo-stp_10.42.42.5(pid=12186): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12186)] 11:06:57.662906 run osmo-stp_10.42.42.5(pid=12186): stdout: | (launched: 2022-12-13_11:06:56.250046) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:57.801117 run osmo-stp_10.42.42.5(pid=12186): stderr: | 20221213110656444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110656444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110656444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110656444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110656445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110656445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110656445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:57.937782 run osmo-stp_10.42.42.5(pid=12186): stdout: | (launched: 2022-12-13_11:06:56.250046) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:58.067463 run osmo-stp_10.42.42.5(pid=12186): stderr: | 20221213110656444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110656444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110656444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110656444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110656445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110656445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110656445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:58.222452 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12186): Process ended prematurely: osmo-stp_10.42.42.5(pid=12186) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12186)] [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:06:58.232301 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:06:58.260052 run osmo-hlr_10.42.42.2(pid=12183): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12183)] 11:06:58.311035 run osmo-hlr_10.42.42.2(pid=12183): stdout: | (launched: 2022-12-13_11:06:55.238061) 11:06:58.363308 run osmo-hlr_10.42.42.2(pid=12183): stderr: | 20221213110655436 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110655436 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110655436 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110655436 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110655436 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110655437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110655449 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110655458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110655458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110655458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:58.435822 run osmo-msc_10.42.42.6(pid=12189): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12189)] 11:06:58.485451 run osmo-msc_10.42.42.6(pid=12189): stdout: | (launched: 2022-12-13_11:06:57.286173) 11:06:58.537788 run osmo-msc_10.42.42.6(pid=12189): stderr: | 20221213110657608 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110657609 DLGLOBAL DEBUG validating counter group 0x7f1878f8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110657609 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110657609 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110657609 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110657609 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110657611 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110657611 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110657611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110657611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:06:58.590068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12182): Terminating (SIGTERM) 11:06:58.631758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12185): Terminating (SIGTERM) 11:06:58.674098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12188): Terminating (SIGTERM) 11:06:58.716910 --- ParallelTerminationStrategy: PID 12182 died... 11:06:58.737582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12182): Terminated: ok {rc=0} 11:06:58.784229 --- ParallelTerminationStrategy: PID 12185 died... 11:06:58.804189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12185): Terminated: ok {rc=0} 11:06:58.850569 --- ParallelTerminationStrategy: PID 12188 died... 11:06:58.870630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12188): Terminated: ok {rc=0} 11:06:58.959241 bus /sierra_3: Setting Powered False 11:07:00.057230 bus /sierra_3: Setting Powered False 11:07:01.186215 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:07:02.443393 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:07:02.450716 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:07:02.473889 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:07:02.500236 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:07:02.550898 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:07:02.574558 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:07:02.601151 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:07:03.154655 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:07:03.207763 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:07:03.219353 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:07:03.280314 tst mo_mt_call.py: using LAC 33519 11:07:03.406626 tst mo_mt_call.py: using RAC 114 11:07:03.531710 tst mo_mt_call.py: using CellId 33519 11:07:03.659771 tst mo_mt_call.py: using BVCI 33520 11:07:03.779331 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:07:03.790937 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:07:03.802407 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:07:03.813767 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:07:03.825627 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:07:03.837311 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:07:03.954095 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:07:04.074951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:04.575534 run create_hlr_db(pid=12194): Launched 11:07:04.698323 bus /sierra_2: Setting Powered False 11:07:05.762729 run create_hlr_db(pid=12194): Terminated: ok {rc=0} 11:07:06.212583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12196): Launched 11:07:06.537897 run osmo-hlr_10.42.42.2(pid=12197): Launched 11:07:06.662321 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:07.219453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12199): Launched 11:07:07.543984 run osmo-stp_10.42.42.5(pid=12200): Launched 11:07:07.668144 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:08.254684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12202): Launched 11:07:08.579957 run osmo-msc_10.42.42.6(pid=12203): Launched 11:07:08.761553 run osmo-stp_10.42.42.5(pid=12200): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12200)] 11:07:08.898518 run osmo-stp_10.42.42.5(pid=12200): stdout: | (launched: 2022-12-13_11:07:07.484640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:09.035223 run osmo-stp_10.42.42.5(pid=12200): stderr: | 20221213110707679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110707680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110707680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110707680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110707681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110707681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110707681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:09.171791 run osmo-stp_10.42.42.5(pid=12200): stdout: | (launched: 2022-12-13_11:07:07.484640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:09.300562 run osmo-stp_10.42.42.5(pid=12200): stderr: | 20221213110707679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110707680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110707680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110707680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110707681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110707681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110707681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:09.455346 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12200): Process ended prematurely: osmo-stp_10.42.42.5(pid=12200) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12200)] [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:07:09.464757 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:07:09.492574 run osmo-hlr_10.42.42.2(pid=12197): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12197)] 11:07:09.543551 run osmo-hlr_10.42.42.2(pid=12197): stdout: | (launched: 2022-12-13_11:07:06.478676) 11:07:09.595840 run osmo-hlr_10.42.42.2(pid=12197): stderr: | 20221213110706678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110706678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110706678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110706678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110706678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110706678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110706690 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110706698 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110706698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110706698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:09.668671 run osmo-msc_10.42.42.6(pid=12203): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12203)] 11:07:09.719120 run osmo-msc_10.42.42.6(pid=12203): stdout: | (launched: 2022-12-13_11:07:08.521073) 11:07:09.771278 run osmo-msc_10.42.42.6(pid=12203): stderr: | 20221213110708844 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110708844 DLGLOBAL DEBUG validating counter group 0x7f6a91bc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110708845 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110708845 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110708845 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110708845 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110708847 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110708848 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110708848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110708848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:09.823741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12196): Terminating (SIGTERM) 11:07:09.865406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12199): Terminating (SIGTERM) 11:07:09.907278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12202): Terminating (SIGTERM) 11:07:09.949525 --- ParallelTerminationStrategy: PID 12196 died... 11:07:09.969813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12196): Terminated: ok {rc=0} 11:07:10.016009 --- ParallelTerminationStrategy: PID 12199 died... 11:07:10.036136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12199): Terminated: ok {rc=0} 11:07:10.082004 --- ParallelTerminationStrategy: PID 12202 died... 11:07:10.101855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12202): Terminated: ok {rc=0} 11:07:10.189458 bus /sierra_3: Setting Powered False 11:07:11.288167 bus /sierra_3: Setting Powered False 11:07:12.404668 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:07:13.551332 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:07:13.563310 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:07:13.622480 tst mo_mt_call_osmux.py: using LAC 33520 11:07:13.742260 tst mo_mt_call_osmux.py: using RAC 115 11:07:13.862417 tst mo_mt_call_osmux.py: using CellId 33520 11:07:13.980935 tst mo_mt_call_osmux.py: using BVCI 33521 11:07:14.089973 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:07:14.101209 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:07:14.112157 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:07:14.122974 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:07:14.133979 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:07:14.144788 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:07:14.259876 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:07:14.382064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:14.885209 run create_hlr_db(pid=12205): Launched 11:07:15.010480 bus /sierra_2: Setting Powered False 11:07:16.072914 run create_hlr_db(pid=12205): Terminated: ok {rc=0} 11:07:16.530007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12207): Launched 11:07:16.869682 run osmo-hlr_10.42.42.2(pid=12208): Launched 11:07:17.019462 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:17.658039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12210): Launched 11:07:17.984093 run osmo-stp_10.42.42.5(pid=12211): Launched 11:07:18.107481 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:18.696095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12213): Launched 11:07:19.020559 run osmo-msc_10.42.42.6(pid=12214): Launched 11:07:19.202201 run osmo-stp_10.42.42.5(pid=12211): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12211)] 11:07:19.339086 run osmo-stp_10.42.42.5(pid=12211): stdout: | (launched: 2022-12-13_11:07:17.924475) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:19.476755 run osmo-stp_10.42.42.5(pid=12211): stderr: | 20221213110718118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110718118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110718118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110718118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110718119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110718119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110718119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:19.613577 run osmo-stp_10.42.42.5(pid=12211): stdout: | (launched: 2022-12-13_11:07:17.924475) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:19.743723 run osmo-stp_10.42.42.5(pid=12211): stderr: | 20221213110718118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110718118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110718118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110718118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110718119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110718119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110718119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:19.898617 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12211): Process ended prematurely: osmo-stp_10.42.42.5(pid=12211) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12211)] [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:07:19.908531 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:07:19.936258 run osmo-hlr_10.42.42.2(pid=12208): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12208)] 11:07:19.987121 run osmo-hlr_10.42.42.2(pid=12208): stdout: | (launched: 2022-12-13_11:07:16.810872) 11:07:20.038822 run osmo-hlr_10.42.42.2(pid=12208): stderr: | 20221213110717164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110717164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110717164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110717164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110717164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110717164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110717182 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110717190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110717190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110717190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:20.111418 run osmo-msc_10.42.42.6(pid=12214): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12214)] 11:07:20.161179 run osmo-msc_10.42.42.6(pid=12214): stdout: | (launched: 2022-12-13_11:07:18.961421) 11:07:20.213276 run osmo-msc_10.42.42.6(pid=12214): stderr: | 20221213110719283 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110719283 DLGLOBAL DEBUG validating counter group 0x7f9d02a45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110719283 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110719283 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110719284 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110719284 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110719285 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110719286 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110719286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110719286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:20.265498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12207): Terminating (SIGTERM) 11:07:20.307167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12210): Terminating (SIGTERM) 11:07:20.349666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12213): Terminating (SIGTERM) 11:07:20.391997 --- ParallelTerminationStrategy: PID 12207 died... 11:07:20.412537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12207): Terminated: ok {rc=0} 11:07:20.459214 --- ParallelTerminationStrategy: PID 12210 died... 11:07:20.479207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12210): Terminated: ok {rc=0} 11:07:20.525573 --- ParallelTerminationStrategy: PID 12213 died... 11:07:20.545529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12213): Terminated: ok {rc=0} 11:07:20.633503 bus /sierra_3: Setting Powered False 11:07:21.732118 bus /sierra_3: Setting Powered False 11:07:22.848395 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:07:24.086510 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:07:24.093850 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:07:24.117218 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:07:24.143390 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:07:24.193506 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:07:24.217558 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:07:24.243622 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:07:24.798703 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:07:24.850929 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:07:24.862757 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:07:24.923029 tst mo_mt_call.py: using LAC 33521 11:07:25.048186 tst mo_mt_call.py: using RAC 116 11:07:25.177042 tst mo_mt_call.py: using CellId 33521 11:07:25.302511 tst mo_mt_call.py: using BVCI 33522 11:07:25.419665 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:07:25.431226 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:07:25.442698 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:07:25.454161 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:07:25.465970 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:07:25.477731 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:07:25.595001 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:07:25.715317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:26.185204 run create_hlr_db(pid=12219): Launched 11:07:26.308797 bus /sierra_2: Setting Powered False 11:07:27.368848 run create_hlr_db(pid=12219): Terminated: ok {rc=0} 11:07:27.810348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12221): Launched 11:07:28.134462 run osmo-hlr_10.42.42.2(pid=12222): Launched 11:07:28.258902 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:28.816054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12224): Launched 11:07:29.139320 run osmo-stp_10.42.42.5(pid=12225): Launched 11:07:29.263382 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:29.850941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12227): Launched 11:07:30.176129 run osmo-msc_10.42.42.6(pid=12228): Launched 11:07:30.358303 run osmo-stp_10.42.42.5(pid=12225): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12225)] 11:07:30.495578 run osmo-stp_10.42.42.5(pid=12225): stdout: | (launched: 2022-12-13_11:07:29.080111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:30.634016 run osmo-stp_10.42.42.5(pid=12225): stderr: | 20221213110729273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110729273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110729273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110729273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110729274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110729274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110729274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:30.771372 run osmo-stp_10.42.42.5(pid=12225): stdout: | (launched: 2022-12-13_11:07:29.080111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:30.914367 run osmo-stp_10.42.42.5(pid=12225): stderr: | 20221213110729273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110729273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110729273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110729273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110729274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110729274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110729274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:31.065724 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12225): Process ended prematurely: osmo-stp_10.42.42.5(pid=12225) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12225)] [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:07:31.075612 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:07:31.104154 run osmo-hlr_10.42.42.2(pid=12222): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12222)] 11:07:31.154248 run osmo-hlr_10.42.42.2(pid=12222): stdout: | (launched: 2022-12-13_11:07:28.075366) 11:07:31.205920 run osmo-hlr_10.42.42.2(pid=12222): stderr: | 20221213110728271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110728271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110728271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110728271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110728271 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110728271 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110728284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110728292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110728292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110728292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:31.278814 run osmo-msc_10.42.42.6(pid=12228): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12228)] 11:07:31.329134 run osmo-msc_10.42.42.6(pid=12228): stdout: | (launched: 2022-12-13_11:07:30.116875) 11:07:31.380509 run osmo-msc_10.42.42.6(pid=12228): stderr: | 20221213110730436 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110730436 DLGLOBAL DEBUG validating counter group 0x7efeea7afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110730436 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110730436 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110730436 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110730436 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110730438 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110730438 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110730439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110730439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:31.432616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12221): Terminating (SIGTERM) 11:07:31.474438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12224): Terminating (SIGTERM) 11:07:31.518997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12227): Terminating (SIGTERM) 11:07:31.563896 --- ParallelTerminationStrategy: PID 12221 died... 11:07:31.584378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12221): Terminated: ok {rc=0} 11:07:31.631633 --- ParallelTerminationStrategy: PID 12224 died... 11:07:31.651731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12224): Terminated: ok {rc=0} 11:07:31.699335 --- ParallelTerminationStrategy: PID 12227 died... 11:07:31.719162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12227): Terminated: ok {rc=0} 11:07:31.808920 bus /sierra_3: Setting Powered False 11:07:32.906273 bus /sierra_3: Setting Powered False 11:07:34.019500 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:07:35.168513 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:07:35.180720 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:07:35.242487 tst mo_mt_call_osmux.py: using LAC 33522 11:07:35.368663 tst mo_mt_call_osmux.py: using RAC 117 11:07:35.494801 tst mo_mt_call_osmux.py: using CellId 33522 11:07:35.620157 tst mo_mt_call_osmux.py: using BVCI 33523 11:07:35.737618 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:07:35.749403 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:07:35.760825 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:07:35.772437 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:07:35.784328 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:07:35.796151 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:07:35.917127 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:07:36.034362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:36.501754 run create_hlr_db(pid=12230): Launched 11:07:36.625108 bus /sierra_2: Setting Powered False 11:07:37.685943 run create_hlr_db(pid=12230): Terminated: ok {rc=0} 11:07:38.127854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12232): Launched 11:07:38.451820 run osmo-hlr_10.42.42.2(pid=12233): Launched 11:07:38.575334 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:39.135375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12235): Launched 11:07:39.460065 run osmo-stp_10.42.42.5(pid=12236): Launched 11:07:39.584050 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:40.163826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12238): Launched 11:07:40.466685 run osmo-msc_10.42.42.6(pid=12239): Launched 11:07:40.636342 run osmo-stp_10.42.42.5(pid=12236): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12236)] 11:07:40.766274 run osmo-stp_10.42.42.5(pid=12236): stdout: | (launched: 2022-12-13_11:07:39.400238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:40.894199 run osmo-stp_10.42.42.5(pid=12236): stderr: | 20221213110739593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110739593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110739593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110739594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110739596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110739596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110739596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:41.020175 run osmo-stp_10.42.42.5(pid=12236): stdout: | (launched: 2022-12-13_11:07:39.400238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:41.140439 run osmo-stp_10.42.42.5(pid=12236): stderr: | 20221213110739593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110739593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110739593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110739594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110739596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110739596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110739596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:41.284484 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12236): Process ended prematurely: osmo-stp_10.42.42.5(pid=12236) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12236)] [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:07:41.293502 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:07:41.319835 run osmo-hlr_10.42.42.2(pid=12233): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12233)] 11:07:41.367383 run osmo-hlr_10.42.42.2(pid=12233): stdout: | (launched: 2022-12-13_11:07:38.392633) 11:07:41.416563 run osmo-hlr_10.42.42.2(pid=12233): stderr: | 20221213110738593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110738593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110738593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110738593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110738593 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110738593 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110738605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110738613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110738613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110738613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:41.484921 run osmo-msc_10.42.42.6(pid=12239): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12239)] 11:07:41.532337 run osmo-msc_10.42.42.6(pid=12239): stdout: | (launched: 2022-12-13_11:07:40.411155) 11:07:41.581229 run osmo-msc_10.42.42.6(pid=12239): stderr: | 20221213110740685 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110740685 DLGLOBAL DEBUG validating counter group 0x7fe80e0f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110740685 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110740685 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110740685 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110740685 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110740687 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110740687 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110740688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110740688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:41.630242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12232): Terminating (SIGTERM) 11:07:41.669323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12235): Terminating (SIGTERM) 11:07:41.709124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12238): Terminating (SIGTERM) 11:07:41.748638 --- ParallelTerminationStrategy: PID 12232 died... 11:07:41.767655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12232): Terminated: ok {rc=0} 11:07:41.811370 --- ParallelTerminationStrategy: PID 12235 died... 11:07:41.830086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12235): Terminated: ok {rc=0} 11:07:41.873903 --- ParallelTerminationStrategy: PID 12238 died... 11:07:41.892720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12238): Terminated: ok {rc=0} 11:07:41.977602 bus /sierra_3: Setting Powered False 11:07:43.076116 bus /sierra_3: Setting Powered False 11:07:44.188650 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:07:45.430686 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:07:45.438766 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:07:45.462932 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:07:45.490606 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:07:45.541033 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:07:45.565517 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:07:45.592625 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:07:46.177537 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:07:46.245778 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:07:46.260627 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:07:46.329644 tst mo_mt_call.py: using LAC 33523 11:07:46.492600 tst mo_mt_call.py: using RAC 118 11:07:46.612149 tst mo_mt_call.py: using CellId 33523 11:07:46.742077 tst mo_mt_call.py: using BVCI 33524 11:07:46.864412 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:07:46.877312 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:07:46.890022 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:07:46.902472 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:07:46.916237 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:07:46.930138 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:07:47.074884 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:07:47.209644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:47.714412 run create_hlr_db(pid=12244): Launched 11:07:47.840422 bus /sierra_2: Setting Powered False 11:07:48.904511 run create_hlr_db(pid=12244): Terminated: ok {rc=0} 11:07:49.336782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12246): Launched 11:07:49.639024 run osmo-hlr_10.42.42.2(pid=12247): Launched 11:07:49.754125 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:50.273283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12249): Launched 11:07:50.575590 run osmo-stp_10.42.42.5(pid=12250): Launched 11:07:50.689995 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:51.236698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12252): Launched 11:07:51.539239 run osmo-msc_10.42.42.6(pid=12253): Launched 11:07:51.709142 run osmo-stp_10.42.42.5(pid=12250): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12250)] 11:07:51.836087 run osmo-stp_10.42.42.5(pid=12250): stdout: | (launched: 2022-12-13_11:07:50.519897) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:51.964403 run osmo-stp_10.42.42.5(pid=12250): stderr: | 20221213110750692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110750692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110750692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110750693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110750695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110750695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110750695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:52.089976 run osmo-stp_10.42.42.5(pid=12250): stdout: | (launched: 2022-12-13_11:07:50.519897) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:52.209873 run osmo-stp_10.42.42.5(pid=12250): stderr: | 20221213110750692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110750692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110750692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110750693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110750695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110750695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110750695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:52.353097 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12250): Process ended prematurely: osmo-stp_10.42.42.5(pid=12250) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12250)] [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:07:52.362125 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:07:52.388222 run osmo-hlr_10.42.42.2(pid=12247): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12247)] 11:07:52.435475 run osmo-hlr_10.42.42.2(pid=12247): stdout: | (launched: 2022-12-13_11:07:49.583758) 11:07:52.484282 run osmo-hlr_10.42.42.2(pid=12247): stderr: | 20221213110749760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110749760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110749760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110749760 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110749760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110749760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110749798 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110749808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110749808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110749808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:52.552755 run osmo-msc_10.42.42.6(pid=12253): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12253)] 11:07:52.599967 run osmo-msc_10.42.42.6(pid=12253): stdout: | (launched: 2022-12-13_11:07:51.483347) 11:07:52.648655 run osmo-msc_10.42.42.6(pid=12253): stderr: | 20221213110751755 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110751755 DLGLOBAL DEBUG validating counter group 0x7fefcb7a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110751755 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110751755 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110751755 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110751755 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110751757 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110751758 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110751758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110751758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:52.697599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12246): Terminating (SIGTERM) 11:07:52.736730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12249): Terminating (SIGTERM) 11:07:52.775898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12252): Terminating (SIGTERM) 11:07:52.815350 --- ParallelTerminationStrategy: PID 12246 died... 11:07:52.834556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12246): Terminated: ok {rc=0} 11:07:52.878203 --- ParallelTerminationStrategy: PID 12249 died... 11:07:52.896615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12249): Terminated: ok {rc=0} 11:07:52.940309 --- ParallelTerminationStrategy: PID 12252 died... 11:07:52.958901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12252): Terminated: ok {rc=0} 11:07:53.044128 bus /sierra_3: Setting Powered False 11:07:54.143436 bus /sierra_3: Setting Powered False 11:07:55.256588 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:07:56.405652 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:07:56.417857 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:07:56.478731 tst mo_mt_call_osmux.py: using LAC 33524 11:07:56.605423 tst mo_mt_call_osmux.py: using RAC 119 11:07:56.725094 tst mo_mt_call_osmux.py: using CellId 33524 11:07:56.843733 tst mo_mt_call_osmux.py: using BVCI 33525 11:07:56.954617 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:07:56.966002 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:07:56.977114 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:07:56.988177 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:07:56.999168 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:07:57.010145 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:07:57.131297 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:07:57.246948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:57.715721 run create_hlr_db(pid=12255): Launched 11:07:57.839036 bus /sierra_2: Setting Powered False 11:07:58.898866 run create_hlr_db(pid=12255): Terminated: ok {rc=0} 11:07:59.341855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12257): Launched 11:07:59.666180 run osmo-hlr_10.42.42.2(pid=12258): Launched 11:07:59.792229 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:00.351438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12260): Launched 11:08:00.676336 run osmo-stp_10.42.42.5(pid=12261): Launched 11:08:00.801242 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:01.512273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12263): Launched 11:08:01.828898 run osmo-msc_10.42.42.6(pid=12264): Launched 11:08:02.060872 run osmo-stp_10.42.42.5(pid=12261): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12261)] 11:08:02.274627 run osmo-stp_10.42.42.5(pid=12261): stdout: | (launched: 2022-12-13_11:08:00.617112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:02.485201 run osmo-stp_10.42.42.5(pid=12261): stderr: | 20221213110800811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110800811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110800811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110800812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110800812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110800812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110800812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:02.624333 run osmo-stp_10.42.42.5(pid=12261): stdout: | (launched: 2022-12-13_11:08:00.617112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:02.755317 run osmo-stp_10.42.42.5(pid=12261): stderr: | 20221213110800811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110800811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110800811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110800812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110800812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110800812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110800812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:02.911311 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12261): Process ended prematurely: osmo-stp_10.42.42.5(pid=12261) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12261)] [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:08:02.921072 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 11:08:02.948853 run osmo-hlr_10.42.42.2(pid=12258): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12258)] 11:08:03.000016 run osmo-hlr_10.42.42.2(pid=12258): stdout: | (launched: 2022-12-13_11:07:59.607404) 11:08:03.053387 run osmo-hlr_10.42.42.2(pid=12258): stderr: | 20221213110759805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110759805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110759805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110759805 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110759805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110759805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110759852 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110759861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110759861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110759862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:03.127174 run osmo-msc_10.42.42.6(pid=12264): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12264)] 11:08:03.177784 run osmo-msc_10.42.42.6(pid=12264): stdout: | (launched: 2022-12-13_11:08:01.771669) 11:08:03.230609 run osmo-msc_10.42.42.6(pid=12264): stderr: | 20221213110802402 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110802402 DLGLOBAL DEBUG validating counter group 0x7f701a823c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110802402 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110802402 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110802402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110802402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110802404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110802405 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110802405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110802405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:03.283534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12257): Terminating (SIGTERM) 11:08:03.325805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12260): Terminating (SIGTERM) 11:08:03.368735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12263): Terminating (SIGTERM) 11:08:03.411438 --- ParallelTerminationStrategy: PID 12257 died... 11:08:03.432043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12257): Terminated: ok {rc=0} 11:08:03.478960 --- ParallelTerminationStrategy: PID 12260 died... 11:08:03.499030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12260): Terminated: ok {rc=0} 11:08:03.545945 --- ParallelTerminationStrategy: PID 12263 died... 11:08:03.565914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12263): Terminated: ok {rc=0} 11:08:03.655015 bus /sierra_3: Setting Powered False 11:08:04.754414 bus /sierra_3: Setting Powered False 11:08:05.870361 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:08:07.114838 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:07.123214 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:08:07.147530 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:08:07.175677 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:08:07.228400 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:08:07.253027 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:08:07.280443 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:08:07.834350 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:08:07.887650 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:08:07.899506 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:08:07.962932 tst mo_mt_call.py: using LAC 33525 11:08:08.090800 tst mo_mt_call.py: using RAC 120 11:08:08.219168 tst mo_mt_call.py: using CellId 33525 11:08:08.348382 tst mo_mt_call.py: using BVCI 33526 11:08:08.458757 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:08:08.470224 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:08:08.481371 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:08:08.492505 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:08:08.503844 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:08:08.514853 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:08:08.635820 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:08:08.752226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:09.220443 run create_hlr_db(pid=12271): Launched 11:08:09.343183 bus /sierra_2: Setting Powered False 11:08:10.403388 run create_hlr_db(pid=12271): Terminated: ok {rc=0} 11:08:10.846366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12273): Launched 11:08:11.170376 run osmo-hlr_10.42.42.2(pid=12274): Launched 11:08:11.295495 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:11.826770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12276): Launched 11:08:12.129590 run osmo-stp_10.42.42.5(pid=12277): Launched 11:08:12.243783 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:12.791763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12279): Launched 11:08:13.093610 run osmo-msc_10.42.42.6(pid=12280): Launched 11:08:13.262319 run osmo-stp_10.42.42.5(pid=12277): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12277)] 11:08:13.390176 run osmo-stp_10.42.42.5(pid=12277): stdout: | (launched: 2022-12-13_11:08:12.073423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:13.517927 run osmo-stp_10.42.42.5(pid=12277): stderr: | 20221213110812244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110812244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110812245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110812245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110812246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110812246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110812246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:13.643498 run osmo-stp_10.42.42.5(pid=12277): stdout: | (launched: 2022-12-13_11:08:12.073423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:13.763422 run osmo-stp_10.42.42.5(pid=12277): stderr: | 20221213110812244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110812244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110812245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110812245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110812246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110812246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110812246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:13.907052 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12277): Process ended prematurely: osmo-stp_10.42.42.5(pid=12277) [trial-2388↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12277)] [trial-2388↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:08:13.915924 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:08:13.942214 run osmo-hlr_10.42.42.2(pid=12274): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12274)] 11:08:13.989743 run osmo-hlr_10.42.42.2(pid=12274): stdout: | (launched: 2022-12-13_11:08:11.111314) 11:08:14.039055 run osmo-hlr_10.42.42.2(pid=12274): stderr: | 20221213110811310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110811310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110811310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110811310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110811310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110811310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110811325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110811335 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110811335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110811335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:14.108088 run osmo-msc_10.42.42.6(pid=12280): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12280)] 11:08:14.156143 run osmo-msc_10.42.42.6(pid=12280): stdout: | (launched: 2022-12-13_11:08:13.037793) 11:08:14.205173 run osmo-msc_10.42.42.6(pid=12280): stderr: | 20221213110813307 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110813307 DLGLOBAL DEBUG validating counter group 0x7f230d7f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110813308 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110813308 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110813308 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110813308 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110813310 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110813310 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110813310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110813310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:14.254501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12273): Terminating (SIGTERM) 11:08:14.293958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12276): Terminating (SIGTERM) 11:08:14.333342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12279): Terminating (SIGTERM) 11:08:14.373596 --- ParallelTerminationStrategy: PID 12273 died... 11:08:14.392576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12273): Terminated: ok {rc=0} 11:08:14.436309 --- ParallelTerminationStrategy: PID 12276 died... 11:08:14.454937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12276): Terminated: ok {rc=0} 11:08:14.498543 --- ParallelTerminationStrategy: PID 12279 died... 11:08:14.516938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12279): Terminated: ok {rc=0} 11:08:14.601146 bus /sierra_3: Setting Powered False 11:08:15.698519 bus /sierra_3: Setting Powered False 11:08:16.822661 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:08:17.989134 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:08:18.001439 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:08:18.063306 tst mo_mt_call_osmux.py: using LAC 33526 11:08:18.190039 tst mo_mt_call_osmux.py: using RAC 121 11:08:18.318753 tst mo_mt_call_osmux.py: using CellId 33526 11:08:18.445100 tst mo_mt_call_osmux.py: using BVCI 33527 11:08:18.562217 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:08:18.573892 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:08:18.585432 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:08:18.596750 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:08:18.608719 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:08:18.620576 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:08:18.738241 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:08:18.854900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:19.322351 run create_hlr_db(pid=12282): Launched 11:08:19.448471 bus /sierra_2: Setting Powered False 11:08:20.508755 run create_hlr_db(pid=12282): Terminated: ok {rc=0} 11:08:20.953099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12284): Launched 11:08:21.277600 run osmo-hlr_10.42.42.2(pid=12285): Launched 11:08:21.402409 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:21.964816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12287): Launched 11:08:22.288777 run osmo-stp_10.42.42.5(pid=12288): Launched 11:08:22.414437 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:23.004299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12290): Launched 11:08:23.328832 run osmo-msc_10.42.42.6(pid=12291): Launched 11:08:23.509495 run osmo-stp_10.42.42.5(pid=12288): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12288)] 11:08:23.647562 run osmo-stp_10.42.42.5(pid=12288): stdout: | (launched: 2022-12-13_11:08:22.229557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:23.785606 run osmo-stp_10.42.42.5(pid=12288): stderr: | 20221213110822422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110822422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110822422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110822423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110822423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110822423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110822423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:23.922133 run osmo-stp_10.42.42.5(pid=12288): stdout: | (launched: 2022-12-13_11:08:22.229557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:24.051552 run osmo-stp_10.42.42.5(pid=12288): stderr: | 20221213110822422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110822422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110822422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110822423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110822423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110822423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110822423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:24.206852 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12288): Process ended prematurely: osmo-stp_10.42.42.5(pid=12288) [trial-2388↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12288)] [trial-2388↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:08:24.216418 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:08:24.244305 run osmo-hlr_10.42.42.2(pid=12285): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12285)] 11:08:24.294839 run osmo-hlr_10.42.42.2(pid=12285): stdout: | (launched: 2022-12-13_11:08:21.218402) 11:08:24.347421 run osmo-hlr_10.42.42.2(pid=12285): stderr: | 20221213110821417 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110821417 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110821417 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110821417 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110821417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110821417 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110821433 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110821443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110821443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110821443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:24.420170 run osmo-msc_10.42.42.6(pid=12291): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12291)] 11:08:24.470235 run osmo-msc_10.42.42.6(pid=12291): stdout: | (launched: 2022-12-13_11:08:23.269184) 11:08:24.522074 run osmo-msc_10.42.42.6(pid=12291): stderr: | 20221213110823591 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110823591 DLGLOBAL DEBUG validating counter group 0x7fdbdcbdec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110823591 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110823591 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110823591 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110823592 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110823593 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110823594 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110823594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110823594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:24.574524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12284): Terminating (SIGTERM) 11:08:24.616128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12287): Terminating (SIGTERM) 11:08:24.657953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12290): Terminating (SIGTERM) 11:08:24.700482 --- ParallelTerminationStrategy: PID 12284 died... 11:08:24.720777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12284): Terminated: ok {rc=0} 11:08:24.767260 --- ParallelTerminationStrategy: PID 12287 died... 11:08:24.787028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12287): Terminated: ok {rc=0} 11:08:24.832800 --- ParallelTerminationStrategy: PID 12290 died... 11:08:24.853074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12290): Terminated: ok {rc=0} 11:08:24.940166 bus /sierra_3: Setting Powered False 11:08:26.038024 bus /sierra_3: Setting Powered False 11:08:27.152996 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 emergency:nanobts+band-1900 --------------------------------------------------------------------- 11:08:28.390581 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:28.396097 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 11:08:28.419458 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 11:08:28.445653 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 11:08:28.529196 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 11:08:28.552573 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 11:08:28.578760 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 11:08:29.163157 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2388 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 11:08:29.168009 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:08:29.178705 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 11:08:29.216554 tst emergency_mo_mt_call.py: using LAC 33527 11:08:29.333916 tst emergency_mo_mt_call.py: using RAC 122 11:08:29.452341 tst emergency_mo_mt_call.py: using CellId 33527 11:08:29.568679 tst emergency_mo_mt_call.py: using BVCI 33528 11:08:29.689391 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:08:29.700617 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:08:29.711846 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:08:29.723034 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:08:29.734404 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:08:29.746490 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:08:29.862128 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:08:29.974919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:30.427349 run create_hlr_db(pid=12296): Launched 11:08:30.546813 bus /sierra_2: Setting Powered False 11:08:31.611230 run create_hlr_db(pid=12296): Terminated: ok {rc=0} 11:08:32.064759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12298): Launched 11:08:32.386824 run osmo-hlr_10.42.42.2(pid=12299): Launched 11:08:32.507465 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:33.052886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12301): Launched 11:08:33.367150 run osmo-stp_10.42.42.5(pid=12302): Launched 11:08:33.497581 tst emergency_mo_mt_call.py: using MSISDN 8119 11:08:33.659745 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:34.225662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12304): Launched 11:08:34.540012 run osmo-msc_10.42.42.6(pid=12305): Launched 11:08:34.716466 run osmo-stp_10.42.42.5(pid=12302): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12302)] 11:08:34.850769 run osmo-stp_10.42.42.5(pid=12302): stdout: | (launched: 2022-12-13_11:08:33.309389) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:34.985321 run osmo-stp_10.42.42.5(pid=12302): stderr: | 20221213110833502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110833502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110833502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110833502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110833503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110833503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110833503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:35.118882 run osmo-stp_10.42.42.5(pid=12302): stdout: | (launched: 2022-12-13_11:08:33.309389) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:35.244404 run osmo-stp_10.42.42.5(pid=12302): stderr: | 20221213110833502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110833502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110833502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110833502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110833503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110833503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110833503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:35.394617 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12302): Process ended prematurely: osmo-stp_10.42.42.5(pid=12302) [trial-2388↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12302)] [trial-2388↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 11:08:35.403555 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 11:08:35.430810 run osmo-hlr_10.42.42.2(pid=12299): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12299)] 11:08:35.481225 run osmo-hlr_10.42.42.2(pid=12299): stdout: | (launched: 2022-12-13_11:08:32.329078) 11:08:35.533196 run osmo-hlr_10.42.42.2(pid=12299): stderr: | 20221213110832526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110832526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110832526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110832526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110832526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110832526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110832539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110832547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110832548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110832548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:35.605792 run osmo-msc_10.42.42.6(pid=12305): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12305)] 11:08:35.655558 run osmo-msc_10.42.42.6(pid=12305): stdout: | (launched: 2022-12-13_11:08:34.482013) 11:08:35.707160 run osmo-msc_10.42.42.6(pid=12305): stderr: | 20221213110834802 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110834802 DLGLOBAL DEBUG validating counter group 0x7f82c7a10c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110834802 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110834802 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110834802 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110834803 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110834804 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110834805 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110834805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110834805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:35.759744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12298): Terminating (SIGTERM) 11:08:35.801455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12301): Terminating (SIGTERM) 11:08:35.843098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12304): Terminating (SIGTERM) 11:08:35.885302 --- ParallelTerminationStrategy: PID 12298 died... 11:08:35.905533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12298): Terminated: ok {rc=0} 11:08:35.951751 --- ParallelTerminationStrategy: PID 12301 died... 11:08:35.971493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12301): Terminated: ok {rc=0} 11:08:36.017575 --- ParallelTerminationStrategy: PID 12304 died... 11:08:36.037338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12304): Terminated: ok {rc=0} 11:08:36.124868 bus /sierra_3: Setting Powered False 11:08:37.222550 bus /sierra_3: Setting Powered False 11:08:38.337785 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 11:08:39.423694 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:08:39.435671 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 11:08:39.479036 tst emergency_preemptive_call.py: using LAC 33528 11:08:39.595974 tst emergency_preemptive_call.py: using RAC 123 11:08:39.711959 tst emergency_preemptive_call.py: using CellId 33528 11:08:39.828280 tst emergency_preemptive_call.py: using BVCI 33529 11:08:39.936848 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:08:39.947556 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:08:39.958291 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:08:39.968759 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:08:39.979458 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 11:08:39.990141 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:08:40.109407 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:08:40.224461 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:08:40.341187 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:08:40.456760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:40.947021 run create_hlr_db(pid=12307): Launched 11:08:41.066687 bus /sierra_2: Setting Powered False 11:08:42.129436 run create_hlr_db(pid=12307): Terminated: ok {rc=0} 11:08:42.566608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12309): Launched 11:08:42.880840 run osmo-hlr_10.42.42.2(pid=12310): Launched 11:08:43.000447 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:43.541974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12312): Launched 11:08:43.855249 run osmo-stp_10.42.42.5(pid=12313): Launched 11:08:43.985056 tst emergency_preemptive_call.py: using MSISDN 8120 11:08:44.145332 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:44.707632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12315): Launched 11:08:45.026575 run osmo-msc_10.42.42.6(pid=12316): Launched 11:08:45.201703 run osmo-stp_10.42.42.5(pid=12313): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12313)] 11:08:45.335153 run osmo-stp_10.42.42.5(pid=12313): stdout: | (launched: 2022-12-13_11:08:43.797979) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:45.469274 run osmo-stp_10.42.42.5(pid=12313): stderr: | 20221213110843989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110843989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110843989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110843990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110843992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110843992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110843992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:45.601929 run osmo-stp_10.42.42.5(pid=12313): stdout: | (launched: 2022-12-13_11:08:43.797979) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:45.727395 run osmo-stp_10.42.42.5(pid=12313): stderr: | 20221213110843989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110843989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110843989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110843990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110843992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110843992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110843992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:45.878195 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12313): Process ended prematurely: osmo-stp_10.42.42.5(pid=12313) [trial-2388↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12313)] [trial-2388↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 11:08:45.887556 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 11:08:45.915517 run osmo-hlr_10.42.42.2(pid=12310): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12310)] 11:08:45.968563 run osmo-hlr_10.42.42.2(pid=12310): stdout: | (launched: 2022-12-13_11:08:42.822548) 11:08:46.022168 run osmo-hlr_10.42.42.2(pid=12310): stderr: | 20221213110843023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110843023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110843023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110843024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110843024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110843024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110843036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110843047 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110843047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110843047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:46.096031 run osmo-msc_10.42.42.6(pid=12316): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12316)] 11:08:46.147013 run osmo-msc_10.42.42.6(pid=12316): stdout: | (launched: 2022-12-13_11:08:44.969086) 11:08:46.200511 run osmo-msc_10.42.42.6(pid=12316): stderr: | 20221213110845290 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213110845290 DLGLOBAL DEBUG validating counter group 0x7f3ba4170c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213110845290 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213110845290 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213110845290 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213110845290 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213110845292 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213110845293 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213110845293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213110845293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:46.254728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12309): Terminating (SIGTERM) 11:08:46.297450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12312): Terminating (SIGTERM) 11:08:46.341405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12315): Terminating (SIGTERM) 11:08:46.387129 --- ParallelTerminationStrategy: PID 12309 died... 11:08:46.409217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12309): Terminated: ok {rc=0} 11:08:46.457694 --- ParallelTerminationStrategy: PID 12312 died... 11:08:46.479160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12312): Terminated: ok {rc=0} 11:08:46.527822 --- ParallelTerminationStrategy: PID 12315 died... 11:08:46.549432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12315): Terminated: ok {rc=0} 11:08:46.640356 bus /sierra_9: Setting Powered False 11:08:47.753290 bus /sierra_9: Setting Powered False 11:08:48.887075 bus /sierra_8: Setting Powered False 11:08:49.986886 bus /sierra_8: Setting Powered False 11:08:51.103055 bus /sierra_3: Setting Powered False 11:08:52.200183 bus /sierra_3: Setting Powered False 11:08:53.317565 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-1900 --------------------------------------------------------------------- 11:08:54.591572 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:54.597740 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 11:08:54.622230 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 11:08:54.663396 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 11:08:54.751475 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 11:08:54.776198 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 11:08:54.815775 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 11:08:55.404529 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 11:08:55.455630 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:08:55.467351 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 11:08:55.507078 tst cs_paging_gprs_active.py: using LAC 33529 11:08:55.628269 tst cs_paging_gprs_active.py: using RAC 124 11:08:55.751512 tst cs_paging_gprs_active.py: using CellId 33529 11:08:55.873161 tst cs_paging_gprs_active.py: using BVCI 33530 11:08:55.985570 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:08:55.997258 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:08:56.009914 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:08:56.021370 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:08:56.032843 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:08:56.044630 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:08:56.056522 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:08:56.068199 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:08:56.081071 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:08:56.198679 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:08:56.317168 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:08:56.524356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:08:56.849688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12593): Launched 11:08:57.133675 run iperf3-srv_10.42.42.10(pid=12594): Launched 11:08:57.262149 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:08:57.467495 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:08:57.793825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12595): Launched 11:08:58.085678 run iperf3-srv_10.42.42.10(pid=12596): Launched 11:08:58.221678 tst cs_paging_gprs_active.py:38: start network... 11:08:58.442460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:58.955637 run create_hlr_db(pid=12597): Launched 11:08:59.111801 bus /sierra_2: Setting Powered False 11:09:00.175988 run create_hlr_db(pid=12597): Terminated: ok {rc=0} 11:09:00.643965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12599): Launched 11:09:01.015671 run osmo-hlr_10.42.42.2(pid=12600): Launched 11:09:01.288380 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:02.085991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12602): Launched 11:09:02.493623 run osmo-stp_10.42.42.5(pid=12603): Launched 11:09:02.803604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:09:03.523454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12605): Launched 11:09:03.659899 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:09:03.949084 run patchelf(pid=12606): Launched 11:09:04.148628 run osmo-stp_10.42.42.5(pid=12603): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12603)] 11:09:04.290478 run osmo-stp_10.42.42.5(pid=12603): stdout: | (launched: 2022-12-13_11:09:02.420685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:04.432879 run osmo-stp_10.42.42.5(pid=12603): stderr: | 20221213110902775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110902776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110902776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110902777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110902777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110902777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110902777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:04.577266 run osmo-stp_10.42.42.5(pid=12603): stdout: | (launched: 2022-12-13_11:09:02.420685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:04.716021 run osmo-stp_10.42.42.5(pid=12603): stderr: | 20221213110902775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110902776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110902776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110902777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110902777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110902777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110902777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:04.880073 run patchelf(pid=12606): Terminating (SIGINT) 11:09:05.069185 run patchelf(pid=12606): Terminated: ok {rc=0} 11:09:05.205618 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12603): Process ended prematurely: osmo-stp_10.42.42.5(pid=12603) [trial-2388↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12603)] [trial-2388↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 11:09:05.217277 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 11:09:05.247219 run osmo-hlr_10.42.42.2(pid=12600): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12600)] 11:09:05.303446 run osmo-hlr_10.42.42.2(pid=12600): stdout: | (launched: 2022-12-13_11:09:00.937787) 11:09:05.358895 run osmo-hlr_10.42.42.2(pid=12600): stderr: | 20221213110901262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110901262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110901262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110901262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110901263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110901263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110901304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110901326 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110901326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110901326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:05.414427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12593): Terminating (SIGTERM) 11:09:05.458323 run iperf3-srv_10.42.42.10(pid=12594): Terminating (SIGTERM) 11:09:05.506946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12595): Terminating (SIGTERM) 11:09:05.552865 run iperf3-srv_10.42.42.10(pid=12596): Terminating (SIGTERM) 11:09:05.600564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12599): Terminating (SIGTERM) 11:09:05.646012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12602): Terminating (SIGTERM) 11:09:05.694848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12605): Terminating (SIGTERM) 11:09:05.742097 --- ParallelTerminationStrategy: PID 12593 died... 11:09:05.764784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12593): Terminated: ok {rc=0} 11:09:05.817445 --- ParallelTerminationStrategy: PID 12594 died... 11:09:05.839114 run iperf3-srv_10.42.42.10(pid=12594): Terminated {rc=256} 11:09:05.889354 --- ParallelTerminationStrategy: PID 12595 died... 11:09:05.910981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12595): Terminated: ok {rc=0} 11:09:05.960354 --- ParallelTerminationStrategy: PID 12596 died... 11:09:05.982062 run iperf3-srv_10.42.42.10(pid=12596): Terminated {rc=256} 11:09:06.033873 --- ParallelTerminationStrategy: PID 12599 died... 11:09:06.054749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12599): Terminated: ok {rc=0} 11:09:06.104801 --- ParallelTerminationStrategy: PID 12602 died... 11:09:06.126411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12602): Terminated: ok {rc=0} 11:09:06.175343 --- ParallelTerminationStrategy: PID 12605 died... 11:09:06.197787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12605): Terminated: ok {rc=0} 11:09:06.293242 bus /gobi_0: Setting Powered False 11:09:07.396702 bus /gobi_0: Setting Powered False 11:09:08.519339 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 11:09:09.671445 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:09.683177 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 11:09:09.728663 tst iperf3.py: using LAC 33530 11:09:09.854521 tst iperf3.py: using RAC 125 11:09:09.978533 tst iperf3.py: using CellId 33530 11:09:10.101141 tst iperf3.py: using BVCI 33531 11:09:10.217267 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:10.228260 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:10.239295 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:10.250338 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:10.261582 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:10.272636 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:10.283962 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:10.295174 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:10.306495 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:09:10.427289 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:09:10.646437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:09:10.964747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12607): Launched 11:09:11.241949 run iperf3-srv_10.42.42.10(pid=12608): Launched 11:09:11.361186 tst iperf3.py:8: start network... 11:09:11.575704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:12.069212 run create_hlr_db(pid=12609): Launched 11:09:12.191139 bus /gobi_6: Setting Powered False 11:09:13.253755 run create_hlr_db(pid=12609): Terminated: ok {rc=0} 11:09:13.678550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12611): Launched 11:09:13.975843 run osmo-hlr_10.42.42.2(pid=12612): Launched 11:09:14.088313 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:14.613640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12614): Launched 11:09:14.908570 run osmo-stp_10.42.42.5(pid=12615): Launched 11:09:15.021136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:09:15.533467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12617): Launched 11:09:15.646509 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:09:15.936341 run patchelf(pid=12618): Launched 11:09:16.131669 run osmo-stp_10.42.42.5(pid=12615): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12615)] 11:09:16.271100 run osmo-stp_10.42.42.5(pid=12615): stdout: | (launched: 2022-12-13_11:09:14.854446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:16.412729 run osmo-stp_10.42.42.5(pid=12615): stderr: | 20221213110915024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110915024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110915024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110915025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110915025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110915025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110915025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:16.555309 run osmo-stp_10.42.42.5(pid=12615): stdout: | (launched: 2022-12-13_11:09:14.854446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:16.692494 run osmo-stp_10.42.42.5(pid=12615): stderr: | 20221213110915024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110915024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110915024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110915025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110915025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110915025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110915025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:16.853882 run patchelf(pid=12618): Terminating (SIGINT) 11:09:17.040573 run patchelf(pid=12618): Terminated: ok {rc=0} 11:09:17.175225 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12615): Process ended prematurely: osmo-stp_10.42.42.5(pid=12615) [trial-2388↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12615)] [trial-2388↪gprs:nanobts+band-1900↪iperf3.py:8] 11:09:17.186046 tst iperf3.py:8: Test FAILED (7.6 sec) 11:09:17.214767 run osmo-hlr_10.42.42.2(pid=12612): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12612)] 11:09:17.267467 run osmo-hlr_10.42.42.2(pid=12612): stdout: | (launched: 2022-12-13_11:09:13.921197) 11:09:17.320912 run osmo-hlr_10.42.42.2(pid=12612): stderr: | 20221213110914101 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110914101 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110914101 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110914101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110914101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110914101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110914114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110914122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110914122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110914122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:17.374564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12607): Terminating (SIGTERM) 11:09:17.416867 run iperf3-srv_10.42.42.10(pid=12608): Terminating (SIGTERM) 11:09:17.459680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12611): Terminating (SIGTERM) 11:09:17.502447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12614): Terminating (SIGTERM) 11:09:17.545720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12617): Terminating (SIGTERM) 11:09:17.589020 --- ParallelTerminationStrategy: PID 12607 died... 11:09:17.610039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12607): Terminated: ok {rc=0} 11:09:17.657723 --- ParallelTerminationStrategy: PID 12608 died... 11:09:17.678262 run iperf3-srv_10.42.42.10(pid=12608): Terminated {rc=256} 11:09:17.725524 --- ParallelTerminationStrategy: PID 12611 died... 11:09:17.746232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12611): Terminated: ok {rc=0} 11:09:17.793392 --- ParallelTerminationStrategy: PID 12614 died... 11:09:17.813334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12614): Terminated: ok {rc=0} 11:09:17.860159 --- ParallelTerminationStrategy: PID 12617 died... 11:09:17.880273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12617): Terminated: ok {rc=0} 11:09:17.969345 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 11:09:19.120522 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:19.132240 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 11:09:19.169257 tst iperf3m4.py: using LAC 33531 11:09:19.294654 tst iperf3m4.py: using RAC 126 11:09:19.418286 tst iperf3m4.py: using CellId 33531 11:09:19.541943 tst iperf3m4.py: using BVCI 33532 11:09:19.656905 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:19.667925 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:19.678980 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:19.689878 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:19.701078 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:19.712122 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:19.723344 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:19.734577 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:19.746133 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:09:19.867539 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:09:19.985973 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:09:20.101249 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:09:20.216713 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:09:20.416286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:09:20.717063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12619): Launched 11:09:20.975417 run iperf3-srv_10.42.42.10(pid=12620): Launched 11:09:21.087397 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:09:21.285787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:09:21.585218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12621): Launched 11:09:21.843838 run iperf3-srv_10.42.42.10(pid=12622): Launched 11:09:21.954941 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:09:22.152445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:09:22.450533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12623): Launched 11:09:22.709545 run iperf3-srv_10.42.42.10(pid=12624): Launched 11:09:22.819769 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:09:23.016219 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:09:23.313030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12625): Launched 11:09:23.571311 run iperf3-srv_10.42.42.10(pid=12626): Launched 11:09:23.682149 tst iperf3m4.py:8: start network... 11:09:23.879940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:24.338300 run create_hlr_db(pid=12627): Launched 11:09:24.460237 bus /gobi_6: Setting Powered False 11:09:25.520051 run create_hlr_db(pid=12627): Terminated: ok {rc=0} 11:09:25.956240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12629): Launched 11:09:26.275048 run osmo-hlr_10.42.42.2(pid=12630): Launched 11:09:26.397141 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:26.948229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12632): Launched 11:09:27.267270 run osmo-stp_10.42.42.5(pid=12633): Launched 11:09:27.389667 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:09:27.940933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12635): Launched 11:09:28.063313 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:09:28.333325 run patchelf(pid=12636): Launched 11:09:28.513435 run osmo-stp_10.42.42.5(pid=12633): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12633)] 11:09:28.648756 run osmo-stp_10.42.42.5(pid=12633): stdout: | (launched: 2022-12-13_11:09:27.209070) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:28.786575 run osmo-stp_10.42.42.5(pid=12633): stderr: | 20221213110927400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110927400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110927400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110927401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110927401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110927401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110927401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:28.923538 run osmo-stp_10.42.42.5(pid=12633): stdout: | (launched: 2022-12-13_11:09:27.209070) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:29.055029 run osmo-stp_10.42.42.5(pid=12633): stderr: | 20221213110927400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110927400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110927400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110927401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110927401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110927401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110927401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:29.210483 run patchelf(pid=12636): Terminating (SIGINT) 11:09:29.390560 run patchelf(pid=12636): Terminated: ok {rc=0} 11:09:29.520317 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12633): Process ended prematurely: osmo-stp_10.42.42.5(pid=12633) [trial-2388↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12633)] [trial-2388↪gprs:nanobts+band-1900↪iperf3m4.py:8] 11:09:29.530476 tst iperf3m4.py:8: Test FAILED (10.5 sec) 11:09:29.558933 run osmo-hlr_10.42.42.2(pid=12630): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12630)] 11:09:29.609727 run osmo-hlr_10.42.42.2(pid=12630): stdout: | (launched: 2022-12-13_11:09:26.216688) 11:09:29.661524 run osmo-hlr_10.42.42.2(pid=12630): stderr: | 20221213110926413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110926413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110926413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110926413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110926413 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110926413 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110926425 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110926433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110926433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110926433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:29.713746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12619): Terminating (SIGTERM) 11:09:29.755623 run iperf3-srv_10.42.42.10(pid=12620): Terminating (SIGTERM) 11:09:29.797605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12621): Terminating (SIGTERM) 11:09:29.839617 run iperf3-srv_10.42.42.10(pid=12622): Terminating (SIGTERM) 11:09:29.882386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12623): Terminating (SIGTERM) 11:09:29.928987 run iperf3-srv_10.42.42.10(pid=12624): Terminating (SIGTERM) 11:09:29.971127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12625): Terminating (SIGTERM) 11:09:30.013651 run iperf3-srv_10.42.42.10(pid=12626): Terminating (SIGTERM) 11:09:30.055631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12629): Terminating (SIGTERM) 11:09:30.098020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12632): Terminating (SIGTERM) 11:09:30.140012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12635): Terminating (SIGTERM) 11:09:30.182580 --- ParallelTerminationStrategy: PID 12619 died... 11:09:30.203442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12619): Terminated: ok {rc=0} 11:09:30.250487 --- ParallelTerminationStrategy: PID 12620 died... 11:09:30.270868 run iperf3-srv_10.42.42.10(pid=12620): Terminated {rc=256} 11:09:30.317701 --- ParallelTerminationStrategy: PID 12621 died... 11:09:30.337992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12621): Terminated: ok {rc=0} 11:09:30.384425 --- ParallelTerminationStrategy: PID 12622 died... 11:09:30.404660 run iperf3-srv_10.42.42.10(pid=12622): Terminated {rc=256} 11:09:30.451036 --- ParallelTerminationStrategy: PID 12623 died... 11:09:30.471363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12623): Terminated: ok {rc=0} 11:09:30.517835 --- ParallelTerminationStrategy: PID 12624 died... 11:09:30.538065 run iperf3-srv_10.42.42.10(pid=12624): Terminated {rc=256} 11:09:30.584722 --- ParallelTerminationStrategy: PID 12625 died... 11:09:30.605409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12625): Terminated: ok {rc=0} 11:09:30.652090 --- ParallelTerminationStrategy: PID 12626 died... 11:09:30.672574 run iperf3-srv_10.42.42.10(pid=12626): Terminated {rc=256} 11:09:30.719754 --- ParallelTerminationStrategy: PID 12629 died... 11:09:30.740077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12629): Terminated: ok {rc=0} 11:09:30.787298 --- ParallelTerminationStrategy: PID 12632 died... 11:09:30.807571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12632): Terminated: ok {rc=0} 11:09:30.854669 --- ParallelTerminationStrategy: PID 12635 died... 11:09:30.875581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12635): Terminated: ok {rc=0} 11:09:30.981322 bus /gobi_4: Setting Powered False 11:09:32.095736 bus /gobi_4: Setting Powered False 11:09:33.229801 bus /gobi_1: Setting Powered False 11:09:34.328039 bus /gobi_1: Setting Powered False 11:09:35.442530 bus /gobi_0: Setting Powered False 11:09:36.540463 bus /gobi_0: Setting Powered False 11:09:37.655982 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 11:09:38.758527 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:38.770428 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 11:09:38.813539 tst ping.py: using LAC 33532 11:09:38.937354 tst ping.py: using RAC 127 11:09:39.058295 tst ping.py: using CellId 33532 11:09:39.178014 tst ping.py: using BVCI 33533 11:09:39.292471 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:39.303583 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:39.314747 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:39.325794 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:39.336827 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:39.348020 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:39.359311 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:39.370637 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:09:39.486801 tst ping.py:19: start network... 11:09:39.681326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:40.131955 run create_hlr_db(pid=12638): Launched 11:09:40.250244 bus /gobi_6: Setting Powered False 11:09:41.309182 run create_hlr_db(pid=12638): Terminated: ok {rc=0} 11:09:41.738363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12640): Launched 11:09:42.052162 run osmo-hlr_10.42.42.2(pid=12641): Launched 11:09:42.171603 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:42.712054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12643): Launched 11:09:43.025678 run osmo-stp_10.42.42.5(pid=12644): Launched 11:09:43.145311 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:09:43.686339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12646): Launched 11:09:43.805955 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:09:44.070119 run patchelf(pid=12647): Launched 11:09:44.243334 run osmo-stp_10.42.42.5(pid=12644): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12644)] 11:09:44.376122 run osmo-stp_10.42.42.5(pid=12644): stdout: | (launched: 2022-12-13_11:09:42.968470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:44.510705 run osmo-stp_10.42.42.5(pid=12644): stderr: | 20221213110943161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110943161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110943162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110943162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110943162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110943163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110943163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:44.644769 run osmo-stp_10.42.42.5(pid=12644): stdout: | (launched: 2022-12-13_11:09:42.968470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:44.773463 run osmo-stp_10.42.42.5(pid=12644): stderr: | 20221213110943161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110943161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110943162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110943162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110943162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110943163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110943163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:44.926184 run patchelf(pid=12647): Terminating (SIGINT) 11:09:45.102108 run patchelf(pid=12647): Terminated: ok {rc=0} 11:09:45.228874 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12644): Process ended prematurely: osmo-stp_10.42.42.5(pid=12644) [trial-2388↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12644)] [trial-2388↪gprs:nanobts+band-1900↪ping.py:22] 11:09:45.238363 tst ping.py:22: Test FAILED (6.5 sec) 11:09:45.266126 run osmo-hlr_10.42.42.2(pid=12641): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12641)] 11:09:45.316824 run osmo-hlr_10.42.42.2(pid=12641): stdout: | (launched: 2022-12-13_11:09:41.994921) 11:09:45.369243 run osmo-hlr_10.42.42.2(pid=12641): stderr: | 20221213110942191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110942191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110942191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110942191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110942191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110942191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110942204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110942212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110942212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110942212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:45.421607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12640): Terminating (SIGTERM) 11:09:45.463056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12643): Terminating (SIGTERM) 11:09:45.505423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12646): Terminating (SIGTERM) 11:09:45.547759 --- ParallelTerminationStrategy: PID 12640 died... 11:09:45.568331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12640): Terminated: ok {rc=0} 11:09:45.614819 --- ParallelTerminationStrategy: PID 12643 died... 11:09:45.634819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12643): Terminated: ok {rc=0} 11:09:45.681166 --- ParallelTerminationStrategy: PID 12646 died... 11:09:45.701427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12646): Terminated: ok {rc=0} 11:09:45.788704 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 11:09:46.873200 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:46.886533 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 11:09:46.930405 tst ping_idle_ping.py: using LAC 33533 11:09:47.054230 tst ping_idle_ping.py: using RAC 128 11:09:47.203858 tst ping_idle_ping.py: using CellId 33533 11:09:47.326625 tst ping_idle_ping.py: using BVCI 33534 11:09:47.431932 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:47.442755 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:47.453271 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:47.463628 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:47.474097 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:47.484402 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:47.495474 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 11:09:47.505985 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 11:09:47.619494 tst ping_idle_ping.py:24: start network... 11:09:47.814187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:48.267977 run create_hlr_db(pid=12648): Launched 11:09:48.387134 bus /gobi_6: Setting Powered False 11:09:49.446490 run create_hlr_db(pid=12648): Terminated: ok {rc=0} 11:09:49.878299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12650): Launched 11:09:50.192871 run osmo-hlr_10.42.42.2(pid=12651): Launched 11:09:50.313439 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:50.858087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12653): Launched 11:09:51.172051 run osmo-stp_10.42.42.5(pid=12654): Launched 11:09:51.292343 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:09:51.836010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12656): Launched 11:09:51.955632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:09:52.221655 run patchelf(pid=12657): Launched 11:09:52.395769 run osmo-stp_10.42.42.5(pid=12654): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12654)] 11:09:52.529317 run osmo-stp_10.42.42.5(pid=12654): stdout: | (launched: 2022-12-13_11:09:51.114380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:52.664017 run osmo-stp_10.42.42.5(pid=12654): stderr: | 20221213110951306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110951306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110951306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110951306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110951309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110951309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110951309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:52.799143 run osmo-stp_10.42.42.5(pid=12654): stdout: | (launched: 2022-12-13_11:09:51.114380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:52.928607 run osmo-stp_10.42.42.5(pid=12654): stderr: | 20221213110951306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213110951306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213110951306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213110951306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213110951309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213110951309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213110951309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:53.081942 run patchelf(pid=12657): Terminating (SIGINT) 11:09:53.259254 run patchelf(pid=12657): Terminated: ok {rc=0} 11:09:53.387048 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12654): Process ended prematurely: osmo-stp_10.42.42.5(pid=12654) [trial-2388↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12654)] [trial-2388↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 11:09:53.396501 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:09:53.424183 run osmo-hlr_10.42.42.2(pid=12651): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12651)] 11:09:53.474740 run osmo-hlr_10.42.42.2(pid=12651): stdout: | (launched: 2022-12-13_11:09:50.135447) 11:09:53.526882 run osmo-hlr_10.42.42.2(pid=12651): stderr: | 20221213110950334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213110950334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213110950334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213110950334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213110950334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213110950334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213110950346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213110950354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213110950355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213110950355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:53.579168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12650): Terminating (SIGTERM) 11:09:53.620636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12653): Terminating (SIGTERM) 11:09:53.662387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12656): Terminating (SIGTERM) 11:09:53.704268 --- ParallelTerminationStrategy: PID 12650 died... 11:09:53.724643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12650): Terminated: ok {rc=0} 11:09:53.770777 --- ParallelTerminationStrategy: PID 12653 died... 11:09:53.790865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12653): Terminated: ok {rc=0} 11:09:53.836936 --- ParallelTerminationStrategy: PID 12656 died... 11:09:53.857177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12656): Terminated: ok {rc=0} 11:09:53.945329 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 11:09:55.241173 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:09:55.247631 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:09:55.271754 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:09:55.312516 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:09:55.401894 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:09:55.425821 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:09:55.465231 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:09:56.059664 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:09:56.112160 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:09:56.123420 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:09:56.164934 tst cs_paging_gprs_active.py: using LAC 33534 11:09:56.299904 tst cs_paging_gprs_active.py: using RAC 129 11:09:56.433062 tst cs_paging_gprs_active.py: using CellId 33534 11:09:56.559236 tst cs_paging_gprs_active.py: using BVCI 33535 11:09:56.676846 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:09:56.688232 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:09:56.699300 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:09:56.710468 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:09:56.722395 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:09:56.734203 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:09:56.746222 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:09:56.758125 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:09:56.770277 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:09:56.889736 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:09:57.004932 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:09:57.204279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:09:57.502702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12662): Launched 11:09:57.761600 run iperf3-srv_10.42.42.10(pid=12663): Launched 11:09:57.872281 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:09:58.070164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:09:58.367458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12664): Launched 11:09:58.626282 run iperf3-srv_10.42.42.10(pid=12665): Launched 11:09:58.736785 tst cs_paging_gprs_active.py:38: start network... 11:09:58.935672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:59.397428 run create_hlr_db(pid=12666): Launched 11:09:59.518622 bus /gobi_6: Setting Powered False 11:10:00.577967 run create_hlr_db(pid=12666): Terminated: ok {rc=0} 11:10:01.006911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12668): Launched 11:10:01.362829 run osmo-hlr_10.42.42.2(pid=12669): Launched 11:10:01.574201 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:02.383893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12674): Launched 11:10:02.693662 run osmo-stp_10.42.42.5(pid=12675): Launched 11:10:02.806139 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:10:03.316715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12677): Launched 11:10:03.429954 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:10:03.680759 run patchelf(pid=12678): Launched 11:10:03.845792 run osmo-stp_10.42.42.5(pid=12675): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12675)] 11:10:03.971794 run osmo-stp_10.42.42.5(pid=12675): stdout: | (launched: 2022-12-13_11:10:02.639174) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:04.099101 run osmo-stp_10.42.42.5(pid=12675): stderr: | 20221213111002812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111002812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111002812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111002813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111002813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111002813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111002813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:04.226340 run osmo-stp_10.42.42.5(pid=12675): stdout: | (launched: 2022-12-13_11:10:02.639174) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:04.348025 run osmo-stp_10.42.42.5(pid=12675): stderr: | 20221213111002812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111002812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111002812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111002813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111002813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111002813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111002813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:04.492266 run patchelf(pid=12678): Terminating (SIGINT) 11:10:04.659583 run patchelf(pid=12678): Terminated: ok {rc=0} 11:10:04.780317 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12675): Process ended prematurely: osmo-stp_10.42.42.5(pid=12675) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12675)] [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:10:04.789768 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:10:04.816695 run osmo-hlr_10.42.42.2(pid=12669): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12669)] 11:10:04.864089 run osmo-hlr_10.42.42.2(pid=12669): stdout: | (launched: 2022-12-13_11:10:01.296398) 11:10:04.913194 run osmo-hlr_10.42.42.2(pid=12669): stderr: | 20221213111001694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111001694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111001694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111001694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111001694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111001694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111001711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111001733 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111001733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111001733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:04.962692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12662): Terminating (SIGTERM) 11:10:05.002364 run iperf3-srv_10.42.42.10(pid=12663): Terminating (SIGTERM) 11:10:05.041816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12664): Terminating (SIGTERM) 11:10:05.081067 run iperf3-srv_10.42.42.10(pid=12665): Terminating (SIGTERM) 11:10:05.120156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12668): Terminating (SIGTERM) 11:10:05.159504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12674): Terminating (SIGTERM) 11:10:05.198655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12677): Terminating (SIGTERM) 11:10:05.238066 --- ParallelTerminationStrategy: PID 12662 died... 11:10:05.256889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12662): Terminated: ok {rc=0} 11:10:05.300477 --- ParallelTerminationStrategy: PID 12663 died... 11:10:05.318971 run iperf3-srv_10.42.42.10(pid=12663): Terminated {rc=256} 11:10:05.362217 --- ParallelTerminationStrategy: PID 12664 died... 11:10:05.380649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12664): Terminated: ok {rc=0} 11:10:05.423921 --- ParallelTerminationStrategy: PID 12665 died... 11:10:05.442274 run iperf3-srv_10.42.42.10(pid=12665): Terminated {rc=256} 11:10:05.485370 --- ParallelTerminationStrategy: PID 12668 died... 11:10:05.503941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12668): Terminated: ok {rc=0} 11:10:05.547203 --- ParallelTerminationStrategy: PID 12674 died... 11:10:05.565674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12674): Terminated: ok {rc=0} 11:10:05.608927 --- ParallelTerminationStrategy: PID 12677 died... 11:10:05.627764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12677): Terminated: ok {rc=0} 11:10:05.712459 bus /gobi_0: Setting Powered False 11:10:06.812097 bus /gobi_0: Setting Powered False 11:10:07.926831 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:10:09.071340 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:09.082759 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:10:09.125237 tst iperf3.py: using LAC 33535 11:10:09.241883 tst iperf3.py: using RAC 130 11:10:09.357897 tst iperf3.py: using CellId 33535 11:10:09.475720 tst iperf3.py: using BVCI 33536 11:10:09.584614 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:09.595535 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:09.606161 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:09.616705 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:09.627331 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:09.637964 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:09.648645 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:09.659147 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:09.669934 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:10:09.788146 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:10:09.986064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:10:10.284227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12679): Launched 11:10:10.542265 run iperf3-srv_10.42.42.10(pid=12680): Launched 11:10:10.652866 tst iperf3.py:8: start network... 11:10:10.851234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:11.311298 run create_hlr_db(pid=12681): Launched 11:10:11.431405 bus /gobi_6: Setting Powered False 11:10:12.490595 run create_hlr_db(pid=12681): Terminated: ok {rc=0} 11:10:12.924589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12683): Launched 11:10:13.244014 run osmo-hlr_10.42.42.2(pid=12684): Launched 11:10:13.365845 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:13.916099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12686): Launched 11:10:14.234964 run osmo-stp_10.42.42.5(pid=12687): Launched 11:10:14.359258 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:10:14.910246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12689): Launched 11:10:15.032111 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:10:15.301720 run patchelf(pid=12690): Launched 11:10:15.479467 run osmo-stp_10.42.42.5(pid=12687): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12687)] 11:10:15.614388 run osmo-stp_10.42.42.5(pid=12687): stdout: | (launched: 2022-12-13_11:10:14.176859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:15.751122 run osmo-stp_10.42.42.5(pid=12687): stderr: | 20221213111014368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111014369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111014369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111014369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111014370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111014370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111014370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:15.904384 run osmo-stp_10.42.42.5(pid=12687): stdout: | (launched: 2022-12-13_11:10:14.176859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:16.040100 run osmo-stp_10.42.42.5(pid=12687): stderr: | 20221213111014368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111014369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111014369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111014369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111014370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111014370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111014370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:16.200198 run patchelf(pid=12690): Terminating (SIGINT) 11:10:16.384566 run patchelf(pid=12690): Terminated: ok {rc=0} 11:10:16.518416 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12687): Process ended prematurely: osmo-stp_10.42.42.5(pid=12687) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12687)] [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 11:10:16.529713 tst iperf3.py:8: Test FAILED (7.5 sec) 11:10:16.559403 run osmo-hlr_10.42.42.2(pid=12684): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12684)] 11:10:16.612623 run osmo-hlr_10.42.42.2(pid=12684): stdout: | (launched: 2022-12-13_11:10:13.185776) 11:10:16.667930 run osmo-hlr_10.42.42.2(pid=12684): stderr: | 20221213111013385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111013385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111013385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111013386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111013386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111013386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111013398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111013407 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111013407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111013407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:16.723096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12679): Terminating (SIGTERM) 11:10:16.766513 run iperf3-srv_10.42.42.10(pid=12680): Terminating (SIGTERM) 11:10:16.813836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12683): Terminating (SIGTERM) 11:10:16.858381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12686): Terminating (SIGTERM) 11:10:16.902341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12689): Terminating (SIGTERM) 11:10:16.946633 --- ParallelTerminationStrategy: PID 12679 died... 11:10:16.968425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12679): Terminated: ok {rc=0} 11:10:17.017380 --- ParallelTerminationStrategy: PID 12680 died... 11:10:17.038591 run iperf3-srv_10.42.42.10(pid=12680): Terminated {rc=256} 11:10:17.086971 --- ParallelTerminationStrategy: PID 12683 died... 11:10:17.108426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12683): Terminated: ok {rc=0} 11:10:17.156425 --- ParallelTerminationStrategy: PID 12686 died... 11:10:17.177984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12686): Terminated: ok {rc=0} 11:10:17.226741 --- ParallelTerminationStrategy: PID 12689 died... 11:10:17.246636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12689): Terminated: ok {rc=0} 11:10:17.335002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:10:18.483164 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:18.494965 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:10:18.536547 tst iperf3m4.py: using LAC 33536 11:10:18.662418 tst iperf3m4.py: using RAC 131 11:10:18.790776 tst iperf3m4.py: using CellId 33536 11:10:18.914841 tst iperf3m4.py: using BVCI 33537 11:10:19.030353 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:19.041721 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:19.052691 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:19.063779 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:19.075143 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:19.086522 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:19.098083 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:19.109427 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:19.121049 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:10:19.238430 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:10:19.355957 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:10:19.474497 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:10:19.590708 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:10:19.789908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:10:20.089139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12691): Launched 11:10:20.347885 run iperf3-srv_10.42.42.10(pid=12692): Launched 11:10:20.459111 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:10:20.657661 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:10:20.955993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12693): Launched 11:10:21.215194 run iperf3-srv_10.42.42.10(pid=12694): Launched 11:10:21.326237 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:10:21.524589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:10:21.822556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12695): Launched 11:10:22.081970 run iperf3-srv_10.42.42.10(pid=12696): Launched 11:10:22.193148 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:10:22.392008 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:10:22.690757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12697): Launched 11:10:22.949594 run iperf3-srv_10.42.42.10(pid=12698): Launched 11:10:23.060238 tst iperf3m4.py:8: start network... 11:10:23.258813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:23.718225 run create_hlr_db(pid=12699): Launched 11:10:23.845866 bus /gobi_6: Setting Powered False 11:10:24.908589 run create_hlr_db(pid=12699): Terminated: ok {rc=0} 11:10:25.355327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12701): Launched 11:10:25.674768 run osmo-hlr_10.42.42.2(pid=12702): Launched 11:10:25.796719 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:26.347942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12704): Launched 11:10:26.669309 run osmo-stp_10.42.42.5(pid=12705): Launched 11:10:26.791869 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:10:27.345788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12707): Launched 11:10:27.467528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:10:27.737728 run patchelf(pid=12708): Launched 11:10:27.915392 run osmo-stp_10.42.42.5(pid=12705): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12705)] 11:10:28.050962 run osmo-stp_10.42.42.5(pid=12705): stdout: | (launched: 2022-12-13_11:10:26.610335) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:28.187721 run osmo-stp_10.42.42.5(pid=12705): stderr: | 20221213111026802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111026802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111026802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111026803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111026803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111026803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111026803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:28.324867 run osmo-stp_10.42.42.5(pid=12705): stdout: | (launched: 2022-12-13_11:10:26.610335) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:28.456263 run osmo-stp_10.42.42.5(pid=12705): stderr: | 20221213111026802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111026802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111026802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111026803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111026803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111026803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111026803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:28.611964 run patchelf(pid=12708): Terminating (SIGINT) 11:10:28.791967 run patchelf(pid=12708): Terminated: ok {rc=0} 11:10:28.922664 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12705): Process ended prematurely: osmo-stp_10.42.42.5(pid=12705) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12705)] [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 11:10:28.932813 tst iperf3m4.py:8: Test FAILED (10.5 sec) 11:10:28.961474 run osmo-hlr_10.42.42.2(pid=12702): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12702)] 11:10:29.011762 run osmo-hlr_10.42.42.2(pid=12702): stdout: | (launched: 2022-12-13_11:10:25.616337) 11:10:29.063880 run osmo-hlr_10.42.42.2(pid=12702): stderr: | 20221213111025813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111025813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111025813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111025813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111025813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111025813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111025830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111025838 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111025838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111025838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:29.115945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12691): Terminating (SIGTERM) 11:10:29.157781 run iperf3-srv_10.42.42.10(pid=12692): Terminating (SIGTERM) 11:10:29.200015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12693): Terminating (SIGTERM) 11:10:29.242706 run iperf3-srv_10.42.42.10(pid=12694): Terminating (SIGTERM) 11:10:29.284887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12695): Terminating (SIGTERM) 11:10:29.327307 run iperf3-srv_10.42.42.10(pid=12696): Terminating (SIGTERM) 11:10:29.369050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12697): Terminating (SIGTERM) 11:10:29.410971 run iperf3-srv_10.42.42.10(pid=12698): Terminating (SIGTERM) 11:10:29.453149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12701): Terminating (SIGTERM) 11:10:29.494951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12704): Terminating (SIGTERM) 11:10:29.536645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12707): Terminating (SIGTERM) 11:10:29.579300 --- ParallelTerminationStrategy: PID 12691 died... 11:10:29.599582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12691): Terminated: ok {rc=0} 11:10:29.645818 --- ParallelTerminationStrategy: PID 12692 died... 11:10:29.665552 run iperf3-srv_10.42.42.10(pid=12692): Terminated {rc=256} 11:10:29.712028 --- ParallelTerminationStrategy: PID 12693 died... 11:10:29.731787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12693): Terminated: ok {rc=0} 11:10:29.777752 --- ParallelTerminationStrategy: PID 12694 died... 11:10:29.797545 run iperf3-srv_10.42.42.10(pid=12694): Terminated {rc=256} 11:10:29.843883 --- ParallelTerminationStrategy: PID 12695 died... 11:10:29.863784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12695): Terminated: ok {rc=0} 11:10:29.909793 --- ParallelTerminationStrategy: PID 12696 died... 11:10:29.929478 run iperf3-srv_10.42.42.10(pid=12696): Terminated {rc=256} 11:10:29.975460 --- ParallelTerminationStrategy: PID 12697 died... 11:10:29.995322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12697): Terminated: ok {rc=0} 11:10:30.041530 --- ParallelTerminationStrategy: PID 12698 died... 11:10:30.061289 run iperf3-srv_10.42.42.10(pid=12698): Terminated {rc=256} 11:10:30.107202 --- ParallelTerminationStrategy: PID 12701 died... 11:10:30.126991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12701): Terminated: ok {rc=0} 11:10:30.173130 --- ParallelTerminationStrategy: PID 12704 died... 11:10:30.192941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12704): Terminated: ok {rc=0} 11:10:30.239210 --- ParallelTerminationStrategy: PID 12707 died... 11:10:30.258977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12707): Terminated: ok {rc=0} 11:10:30.346764 bus /gobi_4: Setting Powered False 11:10:31.459358 bus /gobi_4: Setting Powered False 11:10:32.573674 bus /gobi_1: Setting Powered False 11:10:33.672113 bus /gobi_1: Setting Powered False 11:10:34.788895 bus /gobi_0: Setting Powered False 11:10:35.887492 bus /gobi_0: Setting Powered False 11:10:37.003792 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 11:10:38.106248 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:38.118193 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:10:38.159356 tst ping.py: using LAC 33537 11:10:38.282727 tst ping.py: using RAC 132 11:10:38.404839 tst ping.py: using CellId 33537 11:10:38.526347 tst ping.py: using BVCI 33538 11:10:38.640861 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:38.652112 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:38.663320 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:38.674583 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:38.686061 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:38.697397 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:38.708881 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:38.720196 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:10:38.837853 tst ping.py:19: start network... 11:10:39.047181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:39.530572 run create_hlr_db(pid=12709): Launched 11:10:39.648399 bus /gobi_6: Setting Powered False 11:10:40.710725 run create_hlr_db(pid=12709): Terminated: ok {rc=0} 11:10:41.148003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12711): Launched 11:10:41.460402 run osmo-hlr_10.42.42.2(pid=12712): Launched 11:10:41.580304 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:42.132259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12714): Launched 11:10:42.444795 run osmo-stp_10.42.42.5(pid=12715): Launched 11:10:42.564887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:10:43.106837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12717): Launched 11:10:43.226718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:10:43.491429 run patchelf(pid=12718): Launched 11:10:43.665302 run osmo-stp_10.42.42.5(pid=12715): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12715)] 11:10:43.798003 run osmo-stp_10.42.42.5(pid=12715): stdout: | (launched: 2022-12-13_11:10:42.387600) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:43.932636 run osmo-stp_10.42.42.5(pid=12715): stderr: | 20221213111042577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111042577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111042577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111042578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111042578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111042578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111042579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:44.067431 run osmo-stp_10.42.42.5(pid=12715): stdout: | (launched: 2022-12-13_11:10:42.387600) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:44.195939 run osmo-stp_10.42.42.5(pid=12715): stderr: | 20221213111042577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111042577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111042577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111042578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111042578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111042578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111042579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:44.348195 run patchelf(pid=12718): Terminating (SIGINT) 11:10:44.524150 run patchelf(pid=12718): Terminated: ok {rc=0} 11:10:44.651187 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12715): Process ended prematurely: osmo-stp_10.42.42.5(pid=12715) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12715)] [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 11:10:44.660471 tst ping.py:22: Test FAILED (6.5 sec) 11:10:44.688382 run osmo-hlr_10.42.42.2(pid=12712): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12712)] 11:10:44.738933 run osmo-hlr_10.42.42.2(pid=12712): stdout: | (launched: 2022-12-13_11:10:41.403142) 11:10:44.790719 run osmo-hlr_10.42.42.2(pid=12712): stderr: | 20221213111041603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111041603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111041603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111041603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111041603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111041603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111041616 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111041624 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111041624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111041624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:44.843673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12711): Terminating (SIGTERM) 11:10:44.885357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12714): Terminating (SIGTERM) 11:10:44.927106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12717): Terminating (SIGTERM) 11:10:44.969968 --- ParallelTerminationStrategy: PID 12711 died... 11:10:44.990578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12711): Terminated: ok {rc=0} 11:10:45.037263 --- ParallelTerminationStrategy: PID 12714 died... 11:10:45.057206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12714): Terminated: ok {rc=0} 11:10:45.103370 --- ParallelTerminationStrategy: PID 12717 died... 11:10:45.123170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12717): Terminated: ok {rc=0} 11:10:45.211569 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:10:46.305041 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:46.318421 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:10:46.360828 tst ping_idle_ping.py: using LAC 33538 11:10:46.479243 tst ping_idle_ping.py: using RAC 133 11:10:46.604627 tst ping_idle_ping.py: using CellId 33538 11:10:46.732363 tst ping_idle_ping.py: using BVCI 33539 11:10:46.843739 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:46.855867 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:46.867687 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:46.879763 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:46.893223 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:46.905575 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:46.917994 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:10:46.930308 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:10:47.048372 tst ping_idle_ping.py:24: start network... 11:10:47.293933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:47.755457 run create_hlr_db(pid=12719): Launched 11:10:47.874891 bus /gobi_6: Setting Powered False 11:10:48.934042 run create_hlr_db(pid=12719): Terminated: ok {rc=0} 11:10:49.344809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12721): Launched 11:10:49.637155 run osmo-hlr_10.42.42.2(pid=12722): Launched 11:10:49.748750 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:50.251145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12724): Launched 11:10:50.543252 run osmo-stp_10.42.42.5(pid=12725): Launched 11:10:50.654671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:10:51.159352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12727): Launched 11:10:51.270666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:10:51.517830 run patchelf(pid=12728): Launched 11:10:51.679799 run osmo-stp_10.42.42.5(pid=12725): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12725)] 11:10:51.803354 run osmo-stp_10.42.42.5(pid=12725): stdout: | (launched: 2022-12-13_11:10:50.489072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:51.929268 run osmo-stp_10.42.42.5(pid=12725): stderr: | 20221213111050658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111050658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111050658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111050658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111050659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111050659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111050659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:52.054366 run osmo-stp_10.42.42.5(pid=12725): stdout: | (launched: 2022-12-13_11:10:50.489072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:52.174178 run osmo-stp_10.42.42.5(pid=12725): stderr: | 20221213111050658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111050658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111050658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111050658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111050659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111050659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111050659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:52.315613 run patchelf(pid=12728): Terminating (SIGINT) 11:10:52.480609 run patchelf(pid=12728): Terminated: ok {rc=0} 11:10:52.599440 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12725): Process ended prematurely: osmo-stp_10.42.42.5(pid=12725) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12725)] [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 11:10:52.608183 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 11:10:52.634508 run osmo-hlr_10.42.42.2(pid=12722): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12722)] 11:10:52.681633 run osmo-hlr_10.42.42.2(pid=12722): stdout: | (launched: 2022-12-13_11:10:49.583463) 11:10:52.730382 run osmo-hlr_10.42.42.2(pid=12722): stderr: | 20221213111049760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111049760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111049760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111049760 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111049760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111049760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111049773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111049781 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111049781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111049781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:52.779652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12721): Terminating (SIGTERM) 11:10:52.819080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12724): Terminating (SIGTERM) 11:10:52.858363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12727): Terminating (SIGTERM) 11:10:52.897895 --- ParallelTerminationStrategy: PID 12721 died... 11:10:52.916783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12721): Terminated: ok {rc=0} 11:10:52.960393 --- ParallelTerminationStrategy: PID 12724 died... 11:10:52.978869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12724): Terminated: ok {rc=0} 11:10:53.022397 --- ParallelTerminationStrategy: PID 12727 died... 11:10:53.040844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12727): Terminated: ok {rc=0} 11:10:53.126715 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:10:54.418381 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:54.425424 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:10:54.448672 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:10:54.486145 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:10:54.570987 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:10:54.594185 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:10:54.631521 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:10:55.227433 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:10:55.275086 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:10:55.286293 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:10:55.347038 tst cs_paging_gprs_active.py: using LAC 33539 11:10:55.463771 tst cs_paging_gprs_active.py: using RAC 134 11:10:55.582410 tst cs_paging_gprs_active.py: using CellId 33539 11:10:55.698577 tst cs_paging_gprs_active.py: using BVCI 33540 11:10:55.807272 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:10:55.818261 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:10:55.829030 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:10:55.839631 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:10:55.850681 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:10:55.861314 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:10:55.871925 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:10:55.882485 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:10:55.893726 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:10:56.012306 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:10:56.128879 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:10:56.328189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:10:56.626616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12735): Launched 11:10:56.884607 run iperf3-srv_10.42.42.10(pid=12736): Launched 11:10:56.995532 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:10:57.194138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:10:57.492482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12737): Launched 11:10:57.750660 run iperf3-srv_10.42.42.10(pid=12738): Launched 11:10:57.861644 tst cs_paging_gprs_active.py:38: start network... 11:10:58.060055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:58.519802 run create_hlr_db(pid=12739): Launched 11:10:58.640697 bus /gobi_6: Setting Powered False 11:10:59.700515 run create_hlr_db(pid=12739): Terminated: ok {rc=0} 11:11:00.135751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12741): Launched 11:11:00.455890 run osmo-hlr_10.42.42.2(pid=12742): Launched 11:11:00.578634 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:01.176012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12744): Launched 11:11:01.513550 run osmo-stp_10.42.42.5(pid=12745): Launched 11:11:01.651879 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:11:02.373976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12747): Launched 11:11:02.496217 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:11:02.766259 run patchelf(pid=12748): Launched 11:11:02.944404 run osmo-stp_10.42.42.5(pid=12745): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12745)] 11:11:03.079641 run osmo-stp_10.42.42.5(pid=12745): stdout: | (launched: 2022-12-13_11:11:01.450837) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:03.216462 run osmo-stp_10.42.42.5(pid=12745): stderr: | 20221213111101803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111101803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111101803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111101804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111101804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111101804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111101804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:03.353135 run osmo-stp_10.42.42.5(pid=12745): stdout: | (launched: 2022-12-13_11:11:01.450837) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:03.483816 run osmo-stp_10.42.42.5(pid=12745): stderr: | 20221213111101803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111101803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111101803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111101804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111101804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111101804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111101804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:03.639338 run patchelf(pid=12748): Terminating (SIGINT) 11:11:03.819853 run patchelf(pid=12748): Terminated: ok {rc=0} 11:11:03.949796 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12745): Process ended prematurely: osmo-stp_10.42.42.5(pid=12745) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12745)] [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:11:03.959790 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:11:03.988031 run osmo-hlr_10.42.42.2(pid=12742): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12742)] 11:11:04.038550 run osmo-hlr_10.42.42.2(pid=12742): stdout: | (launched: 2022-12-13_11:11:00.397858) 11:11:04.091317 run osmo-hlr_10.42.42.2(pid=12742): stderr: | 20221213111100594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111100594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111100594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111100594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111100594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111100594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111100606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111100614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111100615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111100615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:04.143700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12735): Terminating (SIGTERM) 11:11:04.185279 run iperf3-srv_10.42.42.10(pid=12736): Terminating (SIGTERM) 11:11:04.227115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12737): Terminating (SIGTERM) 11:11:04.269040 run iperf3-srv_10.42.42.10(pid=12738): Terminating (SIGTERM) 11:11:04.310856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12741): Terminating (SIGTERM) 11:11:04.352849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12744): Terminating (SIGTERM) 11:11:04.394741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12747): Terminating (SIGTERM) 11:11:04.437404 --- ParallelTerminationStrategy: PID 12735 died... 11:11:04.457809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12735): Terminated: ok {rc=0} 11:11:04.504006 --- ParallelTerminationStrategy: PID 12736 died... 11:11:04.523729 run iperf3-srv_10.42.42.10(pid=12736): Terminated {rc=256} 11:11:04.569691 --- ParallelTerminationStrategy: PID 12737 died... 11:11:04.589476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12737): Terminated: ok {rc=0} 11:11:04.635413 --- ParallelTerminationStrategy: PID 12738 died... 11:11:04.655122 run iperf3-srv_10.42.42.10(pid=12738): Terminated {rc=256} 11:11:04.701071 --- ParallelTerminationStrategy: PID 12741 died... 11:11:04.720703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12741): Terminated: ok {rc=0} 11:11:04.766589 --- ParallelTerminationStrategy: PID 12744 died... 11:11:04.786393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12744): Terminated: ok {rc=0} 11:11:04.832635 --- ParallelTerminationStrategy: PID 12747 died... 11:11:04.852425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12747): Terminated: ok {rc=0} 11:11:04.940123 bus /gobi_0: Setting Powered False 11:11:06.040029 bus /gobi_0: Setting Powered False 11:11:07.156780 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:11:08.300409 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:08.311954 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:11:08.376542 tst iperf3.py: using LAC 33540 11:11:08.492085 tst iperf3.py: using RAC 135 11:11:08.606771 tst iperf3.py: using CellId 33540 11:11:08.725114 tst iperf3.py: using BVCI 33541 11:11:08.834194 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:08.845161 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:08.855919 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:08.866651 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:08.877423 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:08.888032 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:08.898862 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:08.909542 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:08.920285 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:11:09.034267 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:11:09.233637 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:11:09.532331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12749): Launched 11:11:09.790899 run iperf3-srv_10.42.42.10(pid=12750): Launched 11:11:09.902504 tst iperf3.py:8: start network... 11:11:10.101078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:10.560806 run create_hlr_db(pid=12751): Launched 11:11:10.682078 bus /gobi_6: Setting Powered False 11:11:11.739353 run create_hlr_db(pid=12751): Terminated: ok {rc=0} 11:11:12.175532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12753): Launched 11:11:12.494604 run osmo-hlr_10.42.42.2(pid=12754): Launched 11:11:12.616694 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:13.168298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12756): Launched 11:11:13.485691 run osmo-stp_10.42.42.5(pid=12757): Launched 11:11:13.607274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:11:14.157219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12759): Launched 11:11:14.278919 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:11:14.548347 run patchelf(pid=12760): Launched 11:11:14.725450 run osmo-stp_10.42.42.5(pid=12757): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12757)] 11:11:14.860613 run osmo-stp_10.42.42.5(pid=12757): stdout: | (launched: 2022-12-13_11:11:13.427986) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:14.997280 run osmo-stp_10.42.42.5(pid=12757): stderr: | 20221213111113619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111113619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111113620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111113620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111113621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111113621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111113621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:15.133746 run osmo-stp_10.42.42.5(pid=12757): stdout: | (launched: 2022-12-13_11:11:13.427986) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:15.264362 run osmo-stp_10.42.42.5(pid=12757): stderr: | 20221213111113619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111113619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111113620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111113620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111113621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111113621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111113621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:15.419037 run patchelf(pid=12760): Terminating (SIGINT) 11:11:15.598286 run patchelf(pid=12760): Terminated: ok {rc=0} 11:11:15.727770 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12757): Process ended prematurely: osmo-stp_10.42.42.5(pid=12757) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12757)] [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 11:11:15.737871 tst iperf3.py:8: Test FAILED (7.5 sec) 11:11:15.766094 run osmo-hlr_10.42.42.2(pid=12754): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12754)] 11:11:15.816087 run osmo-hlr_10.42.42.2(pid=12754): stdout: | (launched: 2022-12-13_11:11:12.436650) 11:11:15.869776 run osmo-hlr_10.42.42.2(pid=12754): stderr: | 20221213111112634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111112634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111112634 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111112634 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111112634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111112634 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111112646 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111112654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111112655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111112655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:15.940070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12749): Terminating (SIGTERM) 11:11:15.981656 run iperf3-srv_10.42.42.10(pid=12750): Terminating (SIGTERM) 11:11:16.024272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12753): Terminating (SIGTERM) 11:11:16.066783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12756): Terminating (SIGTERM) 11:11:16.110444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12759): Terminating (SIGTERM) 11:11:16.154946 --- ParallelTerminationStrategy: PID 12749 died... 11:11:16.174818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12749): Terminated: ok {rc=0} 11:11:16.221732 --- ParallelTerminationStrategy: PID 12750 died... 11:11:16.241406 run iperf3-srv_10.42.42.10(pid=12750): Terminated {rc=256} 11:11:16.287630 --- ParallelTerminationStrategy: PID 12753 died... 11:11:16.307300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12753): Terminated: ok {rc=0} 11:11:16.352289 --- ParallelTerminationStrategy: PID 12756 died... 11:11:16.371919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12756): Terminated: ok {rc=0} 11:11:16.417149 --- ParallelTerminationStrategy: PID 12759 died... 11:11:16.436643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12759): Terminated: ok {rc=0} 11:11:16.528992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:11:17.681506 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:17.692997 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:11:17.755741 tst iperf3m4.py: using LAC 33541 11:11:17.872270 tst iperf3m4.py: using RAC 136 11:11:17.986207 tst iperf3m4.py: using CellId 33541 11:11:18.100534 tst iperf3m4.py: using BVCI 33542 11:11:18.207374 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:18.218461 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:18.229263 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:18.239945 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:18.250748 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:18.261605 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:18.272426 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:18.283167 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:18.294486 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:11:18.415475 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:11:18.538283 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:11:18.653390 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:11:18.773860 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:11:18.990235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:11:19.310797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12761): Launched 11:11:19.589148 run iperf3-srv_10.42.42.10(pid=12762): Launched 11:11:19.709490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:11:19.924605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:11:20.244939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12763): Launched 11:11:20.522079 run iperf3-srv_10.42.42.10(pid=12764): Launched 11:11:20.641718 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:11:20.857341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:11:21.178145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12765): Launched 11:11:21.455399 run iperf3-srv_10.42.42.10(pid=12766): Launched 11:11:21.575222 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:11:21.790443 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:11:22.111528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12767): Launched 11:11:22.388826 run iperf3-srv_10.42.42.10(pid=12768): Launched 11:11:22.508227 tst iperf3m4.py:8: start network... 11:11:22.722999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:23.221234 run create_hlr_db(pid=12769): Launched 11:11:23.342288 bus /gobi_6: Setting Powered False 11:11:24.406006 run create_hlr_db(pid=12769): Terminated: ok {rc=0} 11:11:24.830312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12771): Launched 11:11:25.127487 run osmo-hlr_10.42.42.2(pid=12772): Launched 11:11:25.240743 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:25.753042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12774): Launched 11:11:26.050717 run osmo-stp_10.42.42.5(pid=12775): Launched 11:11:26.163248 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:11:26.673792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12777): Launched 11:11:26.787179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:11:27.036935 run patchelf(pid=12778): Launched 11:11:27.200932 run osmo-stp_10.42.42.5(pid=12775): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12775)] 11:11:27.326475 run osmo-stp_10.42.42.5(pid=12775): stdout: | (launched: 2022-12-13_11:11:25.995706) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:27.453465 run osmo-stp_10.42.42.5(pid=12775): stderr: | 20221213111126165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111126166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111126166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111126166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111126167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111126167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111126167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:27.580450 run osmo-stp_10.42.42.5(pid=12775): stdout: | (launched: 2022-12-13_11:11:25.995706) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:27.702387 run osmo-stp_10.42.42.5(pid=12775): stderr: | 20221213111126165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111126166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111126166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111126166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111126167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111126167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111126167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:27.846392 run patchelf(pid=12778): Terminating (SIGINT) 11:11:28.013354 run patchelf(pid=12778): Terminated: ok {rc=0} 11:11:28.134361 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12775): Process ended prematurely: osmo-stp_10.42.42.5(pid=12775) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12775)] [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:11:28.143688 tst iperf3m4.py:8: Test FAILED (10.5 sec) 11:11:28.170555 run osmo-hlr_10.42.42.2(pid=12772): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12772)] 11:11:28.217067 run osmo-hlr_10.42.42.2(pid=12772): stdout: | (launched: 2022-12-13_11:11:25.073079) 11:11:28.265360 run osmo-hlr_10.42.42.2(pid=12772): stderr: | 20221213111125247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111125247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111125247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111125247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111125247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111125247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111125259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111125268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111125268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111125269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:28.314253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12761): Terminating (SIGTERM) 11:11:28.353427 run iperf3-srv_10.42.42.10(pid=12762): Terminating (SIGTERM) 11:11:28.392376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12763): Terminating (SIGTERM) 11:11:28.431543 run iperf3-srv_10.42.42.10(pid=12764): Terminating (SIGTERM) 11:11:28.470769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12765): Terminating (SIGTERM) 11:11:28.509814 run iperf3-srv_10.42.42.10(pid=12766): Terminating (SIGTERM) 11:11:28.548792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12767): Terminating (SIGTERM) 11:11:28.588384 run iperf3-srv_10.42.42.10(pid=12768): Terminating (SIGTERM) 11:11:28.627431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12771): Terminating (SIGTERM) 11:11:28.666637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12774): Terminating (SIGTERM) 11:11:28.705872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12777): Terminating (SIGTERM) 11:11:28.745303 --- ParallelTerminationStrategy: PID 12761 died... 11:11:28.764257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12761): Terminated: ok {rc=0} 11:11:28.807594 --- ParallelTerminationStrategy: PID 12762 died... 11:11:28.826093 run iperf3-srv_10.42.42.10(pid=12762): Terminated {rc=256} 11:11:28.869256 --- ParallelTerminationStrategy: PID 12763 died... 11:11:28.887757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12763): Terminated: ok {rc=0} 11:11:28.931061 --- ParallelTerminationStrategy: PID 12764 died... 11:11:28.949521 run iperf3-srv_10.42.42.10(pid=12764): Terminated {rc=256} 11:11:28.992524 --- ParallelTerminationStrategy: PID 12765 died... 11:11:29.011017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12765): Terminated: ok {rc=0} 11:11:29.054427 --- ParallelTerminationStrategy: PID 12766 died... 11:11:29.072785 run iperf3-srv_10.42.42.10(pid=12766): Terminated {rc=256} 11:11:29.115876 --- ParallelTerminationStrategy: PID 12767 died... 11:11:29.134355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12767): Terminated: ok {rc=0} 11:11:29.177637 --- ParallelTerminationStrategy: PID 12768 died... 11:11:29.195984 run iperf3-srv_10.42.42.10(pid=12768): Terminated {rc=256} 11:11:29.239091 --- ParallelTerminationStrategy: PID 12771 died... 11:11:29.257610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12771): Terminated: ok {rc=0} 11:11:29.300786 --- ParallelTerminationStrategy: PID 12774 died... 11:11:29.319373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12774): Terminated: ok {rc=0} 11:11:29.362778 --- ParallelTerminationStrategy: PID 12777 died... 11:11:29.381413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12777): Terminated: ok {rc=0} 11:11:29.466627 bus /gobi_4: Setting Powered False 11:11:30.569033 bus /gobi_4: Setting Powered False 11:11:31.684561 bus /gobi_1: Setting Powered False 11:11:32.783744 bus /gobi_1: Setting Powered False 11:11:33.899218 bus /gobi_0: Setting Powered False 11:11:34.997146 bus /gobi_0: Setting Powered False 11:11:36.113540 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:11:37.215620 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:37.227522 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:11:37.289379 tst ping.py: using LAC 33542 11:11:37.413577 tst ping.py: using RAC 137 11:11:37.531767 tst ping.py: using CellId 33542 11:11:37.646483 tst ping.py: using BVCI 33543 11:11:37.752295 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:37.763373 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:37.774204 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:37.784912 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:37.795599 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:37.806424 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:37.817219 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:37.827925 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:11:37.946202 tst ping.py:19: start network... 11:11:38.157234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:38.642988 run create_hlr_db(pid=12781): Launched 11:11:38.762029 bus /gobi_6: Setting Powered False 11:11:39.823653 run create_hlr_db(pid=12781): Terminated: ok {rc=0} 11:11:40.244423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12783): Launched 11:11:40.536403 run osmo-hlr_10.42.42.2(pid=12784): Launched 11:11:40.647874 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:41.158245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12786): Launched 11:11:41.449587 run osmo-stp_10.42.42.5(pid=12787): Launched 11:11:41.560023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:11:42.063384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12789): Launched 11:11:42.174539 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:11:42.419762 run patchelf(pid=12790): Launched 11:11:42.580834 run osmo-stp_10.42.42.5(pid=12787): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12787)] 11:11:42.703939 run osmo-stp_10.42.42.5(pid=12787): stdout: | (launched: 2022-12-13_11:11:41.395571) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:42.828654 run osmo-stp_10.42.42.5(pid=12787): stderr: | 20221213111141565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111141565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111141566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111141566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111141566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111141567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111141567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:42.953599 run osmo-stp_10.42.42.5(pid=12787): stdout: | (launched: 2022-12-13_11:11:41.395571) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:43.072760 run osmo-stp_10.42.42.5(pid=12787): stderr: | 20221213111141565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111141565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111141566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111141566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111141566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111141567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111141567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:43.214103 run patchelf(pid=12790): Terminating (SIGINT) 11:11:43.378127 run patchelf(pid=12790): Terminated: ok {rc=0} 11:11:43.496207 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12787): Process ended prematurely: osmo-stp_10.42.42.5(pid=12787) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12787)] [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 11:11:43.504941 tst ping.py:22: Test FAILED (6.3 sec) 11:11:43.531161 run osmo-hlr_10.42.42.2(pid=12784): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12784)] 11:11:43.577692 run osmo-hlr_10.42.42.2(pid=12784): stdout: | (launched: 2022-12-13_11:11:40.482453) 11:11:43.625903 run osmo-hlr_10.42.42.2(pid=12784): stderr: | 20221213111140657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111140657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111140657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111140657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111140657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111140657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111140669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111140678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111140678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111140678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:43.674605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12783): Terminating (SIGTERM) 11:11:43.713675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12786): Terminating (SIGTERM) 11:11:43.752627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12789): Terminating (SIGTERM) 11:11:43.792318 --- ParallelTerminationStrategy: PID 12783 died... 11:11:43.811481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12783): Terminated: ok {rc=0} 11:11:43.854749 --- ParallelTerminationStrategy: PID 12786 died... 11:11:43.872832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12786): Terminated: ok {rc=0} 11:11:43.916082 --- ParallelTerminationStrategy: PID 12789 died... 11:11:43.934365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12789): Terminated: ok {rc=0} 11:11:44.016411 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:11:45.102110 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:45.114502 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:11:45.176479 tst ping_idle_ping.py: using LAC 33543 11:11:45.300830 tst ping_idle_ping.py: using RAC 138 11:11:45.421743 tst ping_idle_ping.py: using CellId 33543 11:11:45.545345 tst ping_idle_ping.py: using BVCI 33544 11:11:45.659781 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:45.671353 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:45.682755 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:45.694139 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:45.705786 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:45.717327 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:45.728730 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:11:45.740194 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:11:45.866437 tst ping_idle_ping.py:24: start network... 11:11:46.091555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:46.561845 run create_hlr_db(pid=12791): Launched 11:11:46.714068 bus /gobi_6: Setting Powered False 11:11:47.773400 run create_hlr_db(pid=12791): Terminated: ok {rc=0} 11:11:48.205261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12793): Launched 11:11:48.519025 run osmo-hlr_10.42.42.2(pid=12794): Launched 11:11:48.638902 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:49.180115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12796): Launched 11:11:49.494905 run osmo-stp_10.42.42.5(pid=12797): Launched 11:11:49.615063 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:11:50.156768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12799): Launched 11:11:50.277000 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:11:50.542525 run patchelf(pid=12800): Launched 11:11:50.716082 run osmo-stp_10.42.42.5(pid=12797): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12797)] 11:11:50.849029 run osmo-stp_10.42.42.5(pid=12797): stdout: | (launched: 2022-12-13_11:11:49.436420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:50.983394 run osmo-stp_10.42.42.5(pid=12797): stderr: | 20221213111149627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111149628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111149628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111149628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111149629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111149629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111149629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:51.117563 run osmo-stp_10.42.42.5(pid=12797): stdout: | (launched: 2022-12-13_11:11:49.436420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:51.246278 run osmo-stp_10.42.42.5(pid=12797): stderr: | 20221213111149627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111149628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111149628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111149628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111149629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111149629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111149629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:51.398734 run patchelf(pid=12800): Terminating (SIGINT) 11:11:51.574785 run patchelf(pid=12800): Terminated: ok {rc=0} 11:11:51.702029 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12797): Process ended prematurely: osmo-stp_10.42.42.5(pid=12797) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12797)] [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:11:51.711453 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 11:11:51.739444 run osmo-hlr_10.42.42.2(pid=12794): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12794)] 11:11:51.789511 run osmo-hlr_10.42.42.2(pid=12794): stdout: | (launched: 2022-12-13_11:11:48.461819) 11:11:51.841524 run osmo-hlr_10.42.42.2(pid=12794): stderr: | 20221213111148659 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111148659 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111148659 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111148659 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111148659 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111148659 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111148673 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111148681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111148681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111148681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:51.894010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12793): Terminating (SIGTERM) 11:11:51.935536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12796): Terminating (SIGTERM) 11:11:51.977994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12799): Terminating (SIGTERM) 11:11:52.020151 --- ParallelTerminationStrategy: PID 12793 died... 11:11:52.040324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12793): Terminated: ok {rc=0} 11:11:52.086349 --- ParallelTerminationStrategy: PID 12796 died... 11:11:52.106070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12796): Terminated: ok {rc=0} 11:11:52.151974 --- ParallelTerminationStrategy: PID 12799 died... 11:11:52.171614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12799): Terminated: ok {rc=0} 11:11:52.258869 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 11:11:53.551253 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:53.559172 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:11:53.582883 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:11:53.617469 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:11:53.668698 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:11:53.692244 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:11:53.726486 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:11:54.285974 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:11:54.291220 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:11:54.302815 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:11:54.363569 tst switch_tch_pdch.py: using LAC 33544 11:11:54.480321 tst switch_tch_pdch.py: using RAC 139 11:11:54.595460 tst switch_tch_pdch.py: using CellId 33544 11:11:54.710393 tst switch_tch_pdch.py: using BVCI 33545 11:11:54.815662 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:11:54.827222 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:11:54.838458 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:11:54.850244 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:11:54.862278 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:11:54.874188 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:11:54.886231 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:11:54.898267 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:11:55.011960 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:11:55.130324 tst switch_tch_pdch.py:51: start network... 11:11:55.342032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:55.827209 run create_hlr_db(pid=12804): Launched 11:11:55.947511 bus /gobi_6: Setting Powered False 11:11:57.010682 run create_hlr_db(pid=12804): Terminated: ok {rc=0} 11:11:57.429640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12806): Launched 11:11:57.743733 run osmo-hlr_10.42.42.2(pid=12807): Launched 11:11:57.864497 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:58.404283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12809): Launched 11:11:58.717471 run osmo-stp_10.42.42.5(pid=12810): Launched 11:11:58.837389 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:11:59.378242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12812): Launched 11:11:59.498120 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:11:59.762760 run patchelf(pid=12813): Launched 11:11:59.937889 run osmo-stp_10.42.42.5(pid=12810): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12810)] 11:12:00.071249 run osmo-stp_10.42.42.5(pid=12810): stdout: | (launched: 2022-12-13_11:11:58.660186) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:00.205769 run osmo-stp_10.42.42.5(pid=12810): stderr: | 20221213111158852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111158852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111158852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111158852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111158853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111158853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111158853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:00.340691 run osmo-stp_10.42.42.5(pid=12810): stdout: | (launched: 2022-12-13_11:11:58.660186) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:00.469433 run osmo-stp_10.42.42.5(pid=12810): stderr: | 20221213111158852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111158852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111158852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111158852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111158853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111158853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111158853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:00.622224 run patchelf(pid=12813): Terminating (SIGINT) 11:12:00.798734 run patchelf(pid=12813): Terminated: ok {rc=0} 11:12:00.940490 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12810): Process ended prematurely: osmo-stp_10.42.42.5(pid=12810) [trial-2388↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12810)] [trial-2388↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:12:00.951468 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 11:12:00.980932 run osmo-hlr_10.42.42.2(pid=12807): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12807)] 11:12:01.034840 run osmo-hlr_10.42.42.2(pid=12807): stdout: | (launched: 2022-12-13_11:11:57.686588) 11:12:01.087591 run osmo-hlr_10.42.42.2(pid=12807): stderr: | 20221213111157883 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111157883 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111157883 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111157883 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111157883 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111157883 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111157895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111157904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111157904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111157904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:01.141205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12806): Terminating (SIGTERM) 11:12:01.184279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12809): Terminating (SIGTERM) 11:12:01.229425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12812): Terminating (SIGTERM) 11:12:01.274955 --- ParallelTerminationStrategy: PID 12806 died... 11:12:01.296339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12806): Terminated: ok {rc=0} 11:12:01.344174 --- ParallelTerminationStrategy: PID 12809 died... 11:12:01.365172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12809): Terminated: ok {rc=0} 11:12:01.412829 --- ParallelTerminationStrategy: PID 12812 died... 11:12:01.434020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12812): Terminated: ok {rc=0} 11:12:01.522826 bus /gobi_0: Setting Powered False 11:12:02.620035 bus /gobi_0: Setting Powered False 11:12:03.731557 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 sms:nanobts+band-900 --------------------------------------------------------------------- 11:12:04.979214 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:04.984879 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 11:12:05.017849 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 11:12:05.046335 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 11:12:05.098824 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 11:12:05.130643 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 11:12:05.157678 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 11:12:05.701363 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 11:12:05.706386 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:12:05.716939 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 11:12:05.775828 tst mo_mt_sms.py: using LAC 33545 11:12:05.903663 tst mo_mt_sms.py: using RAC 140 11:12:06.027315 tst mo_mt_sms.py: using CellId 33545 11:12:06.153268 tst mo_mt_sms.py: using BVCI 33546 11:12:06.267045 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:12:06.278321 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:12:06.289272 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:12:06.300060 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:12:06.311193 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:12:06.322402 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 11:12:06.437114 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 11:12:06.554563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:07.039753 run create_hlr_db(pid=12817): Launched 11:12:07.158992 bus /gobi_6: Setting Powered False 11:12:08.222256 run create_hlr_db(pid=12817): Terminated: ok {rc=0} 11:12:08.661192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12819): Launched 11:12:08.974776 run osmo-hlr_10.42.42.2(pid=12820): Launched 11:12:09.094201 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:09.630744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12822): Launched 11:12:09.943639 run osmo-stp_10.42.42.5(pid=12823): Launched 11:12:10.063349 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:10.630153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12825): Launched 11:12:10.944145 run osmo-msc_10.42.42.6(pid=12826): Launched 11:12:11.119989 run osmo-stp_10.42.42.5(pid=12823): ERR: Terminated: ERROR {rc=1} [trial-2388↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12823)] 11:12:11.253882 run osmo-stp_10.42.42.5(pid=12823): stdout: | (launched: 2022-12-13_11:12:09.886328) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:11.387841 run osmo-stp_10.42.42.5(pid=12823): stderr: | 20221213111210075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111210076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111210076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111210076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111210077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111210077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111210077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:11.521052 run osmo-stp_10.42.42.5(pid=12823): stdout: | (launched: 2022-12-13_11:12:09.886328) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:11.646487 run osmo-stp_10.42.42.5(pid=12823): stderr: | 20221213111210075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111210076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111210076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111210076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111210077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111210077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111210077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:11.796421 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12823): Process ended prematurely: osmo-stp_10.42.42.5(pid=12823) [trial-2388↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12823)] [trial-2388↪sms:nanobts+band-900↪mo_mt_sms.py:16] 11:12:11.805373 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 11:12:11.832700 run osmo-hlr_10.42.42.2(pid=12820): ERR: Terminated: ERROR {rc=237} [trial-2388↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12820)] 11:12:11.883657 run osmo-hlr_10.42.42.2(pid=12820): stdout: | (launched: 2022-12-13_11:12:08.917632) 11:12:11.935883 run osmo-hlr_10.42.42.2(pid=12820): stderr: | 20221213111209115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111209115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111209115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111209115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111209115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111209115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111209129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111209139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111209139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111209140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:12.008502 run osmo-msc_10.42.42.6(pid=12826): ERR: Terminated: ERROR {rc=2} [trial-2388↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12826)] 11:12:12.058211 run osmo-msc_10.42.42.6(pid=12826): stdout: | (launched: 2022-12-13_11:12:10.886650) 11:12:12.109791 run osmo-msc_10.42.42.6(pid=12826): stderr: | 20221213111211206 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111211206 DLGLOBAL DEBUG validating counter group 0x7fd585cccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111211206 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111211206 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111211207 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111211207 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111211208 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111211209 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111211209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111211209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:12.161837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12819): Terminating (SIGTERM) 11:12:12.203787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12822): Terminating (SIGTERM) 11:12:12.245733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12825): Terminating (SIGTERM) 11:12:12.288177 --- ParallelTerminationStrategy: PID 12819 died... 11:12:12.308547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12819): Terminated: ok {rc=0} 11:12:12.354707 --- ParallelTerminationStrategy: PID 12822 died... 11:12:12.374493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12822): Terminated: ok {rc=0} 11:12:12.420427 --- ParallelTerminationStrategy: PID 12825 died... 11:12:12.440365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12825): Terminated: ok {rc=0} 11:12:12.528119 bus /sierra_3: Setting Powered False 11:12:13.626091 bus /sierra_3: Setting Powered False 11:12:14.744196 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 11:12:16.005945 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:16.011398 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 11:12:16.054903 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 11:12:16.062917 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 11:12:16.099561 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 11:12:16.133290 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 11:12:16.141849 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 11:12:16.667748 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2388 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 11:12:16.675255 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 11:12:16.686959 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 11:12:16.732873 tst assert_extension.py: using LAC 33546 11:12:16.855059 tst assert_extension.py: using RAC 141 11:12:17.013267 tst assert_extension.py: using CellId 33546 11:12:17.130568 tst assert_extension.py: using BVCI 33547 11:12:17.254880 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 11:12:17.373870 tst assert_extension.py:10: start nitb and bts... 11:12:17.586149 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:12:18.226345 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12831): Launched 11:12:18.539308 run osmo-nitb_10.42.42.2(pid=12832): Launched 11:12:18.713882 run osmo-nitb_10.42.42.2(pid=12832): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12832)] 11:12:18.855736 run osmo-nitb_10.42.42.2(pid=12832): stdout: | (launched: 2022-12-13_11:12:18.482301) 11:12:18.998523 run osmo-nitb_10.42.42.2(pid=12832): stderr: | (launched: 2022-12-13_11:12:18.528831) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:12:19.141482 run osmo-nitb_10.42.42.2(pid=12832): stdout: | (launched: 2022-12-13_11:12:18.482301) 11:12:19.278814 run osmo-nitb_10.42.42.2(pid=12832): stderr: | (launched: 2022-12-13_11:12:18.528831) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12832): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12832) [trial-2388↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12832)] 11:12:19.658692 tst osmo-nitb_10.42.42.2(pid=12832): stdout: | (launched: 2022-12-13_11:12:18.482301) 11:12:19.786170 tst osmo-nitb_10.42.42.2(pid=12832): stderr: | (launched: 2022-12-13_11:12:18.528831) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:12:19.936619 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12832): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12832) [trial-2388↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12832)] [trial-2388↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 11:12:19.945570 tst assert_extension.py:12: Test FAILED (3.3 sec) 11:12:19.952471 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12831): Terminating (SIGTERM) 11:12:20.163434 --- ParallelTerminationStrategy: PID 12831 died... 11:12:20.185263 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12831): Terminated: ok {rc=0} 11:12:20.274811 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 ussd:nanobts+band-900 --------------------------------------------------------------------- 11:12:21.451431 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:21.456438 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 11:12:21.488760 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 11:12:21.519039 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 11:12:21.555131 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 11:12:21.588298 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 11:12:21.615903 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 11:12:22.146907 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2388 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 11:12:22.152302 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:12:22.163552 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 11:12:22.211654 tst assert_extension.py: using LAC 33547 11:12:22.334899 tst assert_extension.py: using RAC 142 11:12:22.457150 tst assert_extension.py: using CellId 33547 11:12:22.580929 tst assert_extension.py: using BVCI 33548 11:12:22.694096 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:12:22.705084 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:12:22.715963 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:12:22.726790 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:12:22.738150 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:12:22.749337 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 11:12:22.862930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:23.315103 run create_hlr_db(pid=12837): Launched 11:12:23.434702 bus /sierra_2: Setting Powered False 11:12:24.493156 run create_hlr_db(pid=12837): Terminated: ok {rc=0} 11:12:24.922654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12839): Launched 11:12:25.235977 run osmo-hlr_10.42.42.2(pid=12840): Launched 11:12:25.356720 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:25.900090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12842): Launched 11:12:26.214121 run osmo-stp_10.42.42.5(pid=12843): Launched 11:12:26.334068 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:26.899773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12845): Launched 11:12:27.212194 run osmo-msc_10.42.42.6(pid=12846): Launched 11:12:27.386575 run osmo-stp_10.42.42.5(pid=12843): ERR: Terminated: ERROR {rc=1} [trial-2388↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12843)] 11:12:27.519158 run osmo-stp_10.42.42.5(pid=12843): stdout: | (launched: 2022-12-13_11:12:26.156697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:27.652353 run osmo-stp_10.42.42.5(pid=12843): stderr: | 20221213111226347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111226347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111226347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111226347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111226350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111226350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111226350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:27.785048 run osmo-stp_10.42.42.5(pid=12843): stdout: | (launched: 2022-12-13_11:12:26.156697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:27.910827 run osmo-stp_10.42.42.5(pid=12843): stderr: | 20221213111226347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111226347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111226347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111226347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111226350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111226350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111226350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:28.060580 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12843): Process ended prematurely: osmo-stp_10.42.42.5(pid=12843) [trial-2388↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12843)] [trial-2388↪ussd:nanobts+band-900↪assert_extension.py:17] 11:12:28.069633 tst assert_extension.py:17: Test FAILED (5.9 sec) 11:12:28.096896 run osmo-hlr_10.42.42.2(pid=12840): ERR: Terminated: ERROR {rc=237} [trial-2388↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12840)] 11:12:28.147665 run osmo-hlr_10.42.42.2(pid=12840): stdout: | (launched: 2022-12-13_11:12:25.178765) 11:12:28.199872 run osmo-hlr_10.42.42.2(pid=12840): stderr: | 20221213111225378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111225378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111225378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111225378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111225378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111225378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111225391 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111225401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111225402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111225402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:28.272418 run osmo-msc_10.42.42.6(pid=12846): ERR: Terminated: ERROR {rc=2} [trial-2388↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12846)] 11:12:28.321660 run osmo-msc_10.42.42.6(pid=12846): stdout: | (launched: 2022-12-13_11:12:27.154867) 11:12:28.372815 run osmo-msc_10.42.42.6(pid=12846): stderr: | 20221213111227475 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111227475 DLGLOBAL DEBUG validating counter group 0x7ff4427e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111227475 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111227475 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111227475 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111227475 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111227477 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111227477 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111227478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111227478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:28.425311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12839): Terminating (SIGTERM) 11:12:28.467220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12842): Terminating (SIGTERM) 11:12:28.509067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12845): Terminating (SIGTERM) 11:12:28.551374 --- ParallelTerminationStrategy: PID 12839 died... 11:12:28.571860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12839): Terminated: ok {rc=0} 11:12:28.617994 --- ParallelTerminationStrategy: PID 12842 died... 11:12:28.637797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12842): Terminated: ok {rc=0} 11:12:28.683602 --- ParallelTerminationStrategy: PID 12845 died... 11:12:28.703489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12845): Terminated: ok {rc=0} 11:12:28.790360 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:12:30.000335 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:30.008341 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:12:30.041533 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:12:30.069371 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:12:30.122752 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:12:30.156783 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:12:30.184201 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:12:30.730769 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:12:30.778725 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:12:30.790235 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:12:30.855576 tst mo_mt_call.py: using LAC 33548 11:12:30.988915 tst mo_mt_call.py: using RAC 143 11:12:31.127916 tst mo_mt_call.py: using CellId 33548 11:12:31.296147 tst mo_mt_call.py: using BVCI 33549 11:12:31.418468 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:12:31.431362 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:12:31.444181 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:12:31.456845 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:12:31.470818 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:12:31.484320 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:12:31.610093 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:12:31.735712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:32.245956 run create_hlr_db(pid=12851): Launched 11:12:32.370198 bus /sierra_2: Setting Powered False 11:12:33.434078 run create_hlr_db(pid=12851): Terminated: ok {rc=0} 11:12:33.862259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12853): Launched 11:12:34.158952 run osmo-hlr_10.42.42.2(pid=12854): Launched 11:12:34.271838 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:34.782361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12856): Launched 11:12:35.078240 run osmo-stp_10.42.42.5(pid=12857): Launched 11:12:35.189936 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:35.725755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12859): Launched 11:12:36.022535 run osmo-msc_10.42.42.6(pid=12860): Launched 11:12:36.188063 run osmo-stp_10.42.42.5(pid=12857): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12857)] 11:12:36.314620 run osmo-stp_10.42.42.5(pid=12857): stdout: | (launched: 2022-12-13_11:12:35.023683) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:36.439905 run osmo-stp_10.42.42.5(pid=12857): stderr: | 20221213111235195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111235195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111235195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111235196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111235196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111235196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111235196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:36.563637 run osmo-stp_10.42.42.5(pid=12857): stdout: | (launched: 2022-12-13_11:12:35.023683) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:36.681890 run osmo-stp_10.42.42.5(pid=12857): stderr: | 20221213111235195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111235195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111235195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111235196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111235196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111235196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111235196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:36.823181 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12857): Process ended prematurely: osmo-stp_10.42.42.5(pid=12857) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12857)] [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:12:36.831879 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:12:36.857918 run osmo-hlr_10.42.42.2(pid=12854): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12854)] 11:12:36.905087 run osmo-hlr_10.42.42.2(pid=12854): stdout: | (launched: 2022-12-13_11:12:34.104413) 11:12:36.953751 run osmo-hlr_10.42.42.2(pid=12854): stderr: | 20221213111234280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111234280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111234280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111234280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111234280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111234280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111234297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111234306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111234306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111234306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:37.022081 run osmo-msc_10.42.42.6(pid=12860): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12860)] 11:12:37.069122 run osmo-msc_10.42.42.6(pid=12860): stdout: | (launched: 2022-12-13_11:12:35.967567) 11:12:37.117990 run osmo-msc_10.42.42.6(pid=12860): stderr: | 20221213111236238 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111236238 DLGLOBAL DEBUG validating counter group 0x7f3609967c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111236238 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111236239 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111236239 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111236239 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111236241 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111236241 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111236241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111236241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:37.167179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12853): Terminating (SIGTERM) 11:12:37.206426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12856): Terminating (SIGTERM) 11:12:37.245733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12859): Terminating (SIGTERM) 11:12:37.285298 --- ParallelTerminationStrategy: PID 12853 died... 11:12:37.304240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12853): Terminated: ok {rc=0} 11:12:37.347717 --- ParallelTerminationStrategy: PID 12856 died... 11:12:37.366151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12856): Terminated: ok {rc=0} 11:12:37.409419 --- ParallelTerminationStrategy: PID 12859 died... 11:12:37.427895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12859): Terminated: ok {rc=0} 11:12:37.513021 bus /sierra_3: Setting Powered False 11:12:38.613314 bus /sierra_3: Setting Powered False 11:12:39.729954 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:12:40.880403 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:12:40.892595 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:12:40.961934 tst mo_mt_call_osmux.py: using LAC 33549 11:12:41.088168 tst mo_mt_call_osmux.py: using RAC 144 11:12:41.215224 tst mo_mt_call_osmux.py: using CellId 33549 11:12:41.342245 tst mo_mt_call_osmux.py: using BVCI 33550 11:12:41.458612 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:12:41.470122 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:12:41.481642 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:12:41.493089 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:12:41.505333 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:12:41.517490 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:12:41.636002 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:12:41.755982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:42.253678 run create_hlr_db(pid=12862): Launched 11:12:42.374420 bus /sierra_2: Setting Powered False 11:12:43.433316 run create_hlr_db(pid=12862): Terminated: ok {rc=0} 11:12:43.857616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12864): Launched 11:12:44.153615 run osmo-hlr_10.42.42.2(pid=12865): Launched 11:12:44.266779 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:44.778183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12867): Launched 11:12:45.075122 run osmo-stp_10.42.42.5(pid=12868): Launched 11:12:45.188751 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:45.726239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12870): Launched 11:12:46.069154 run osmo-msc_10.42.42.6(pid=12871): Launched 11:12:46.543598 run osmo-stp_10.42.42.5(pid=12868): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12868)] 11:12:46.815306 run osmo-stp_10.42.42.5(pid=12868): stdout: | (launched: 2022-12-13_11:12:45.020244) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:46.980679 run osmo-stp_10.42.42.5(pid=12868): stderr: | 20221213111245191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111245191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111245192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111245192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111245193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111245193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111245193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:47.126921 run osmo-stp_10.42.42.5(pid=12868): stdout: | (launched: 2022-12-13_11:12:45.020244) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:47.258419 run osmo-stp_10.42.42.5(pid=12868): stderr: | 20221213111245191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111245191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111245192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111245192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111245193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111245193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111245193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:47.415988 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12868): Process ended prematurely: osmo-stp_10.42.42.5(pid=12868) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12868)] [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:12:47.425739 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 11:12:47.454155 run osmo-hlr_10.42.42.2(pid=12865): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12865)] 11:12:47.508295 run osmo-hlr_10.42.42.2(pid=12865): stdout: | (launched: 2022-12-13_11:12:44.099027) 11:12:47.560543 run osmo-hlr_10.42.42.2(pid=12865): stderr: | 20221213111244277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111244277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111244277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111244277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111244277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111244277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111244294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111244303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111244303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111244304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:47.633646 run osmo-msc_10.42.42.6(pid=12871): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12871)] 11:12:47.683971 run osmo-msc_10.42.42.6(pid=12871): stdout: | (launched: 2022-12-13_11:12:46.005704) 11:12:47.737085 run osmo-msc_10.42.42.6(pid=12871): stderr: | 20221213111246483 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111246483 DLGLOBAL DEBUG validating counter group 0x7fe15e769c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111246483 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111246483 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111246485 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111246487 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111246488 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111246491 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111246491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111246491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:47.789392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12864): Terminating (SIGTERM) 11:12:47.831859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12867): Terminating (SIGTERM) 11:12:47.874901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12870): Terminating (SIGTERM) 11:12:47.917908 --- ParallelTerminationStrategy: PID 12864 died... 11:12:47.938967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12864): Terminated: ok {rc=0} 11:12:47.986162 --- ParallelTerminationStrategy: PID 12867 died... 11:12:48.006742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12867): Terminated: ok {rc=0} 11:12:48.053769 --- ParallelTerminationStrategy: PID 12870 died... 11:12:48.074227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12870): Terminated: ok {rc=0} 11:12:48.162645 bus /sierra_3: Setting Powered False 11:12:49.261522 bus /sierra_3: Setting Powered False 11:12:50.376763 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:12:51.629220 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:51.637182 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:12:51.669476 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:12:51.697269 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:12:51.750190 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:12:51.784215 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:12:51.811093 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:12:52.359024 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:12:52.408002 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:12:52.419165 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:12:52.485852 tst mo_mt_call.py: using LAC 33550 11:12:52.612388 tst mo_mt_call.py: using RAC 145 11:12:52.736395 tst mo_mt_call.py: using CellId 33550 11:12:52.860713 tst mo_mt_call.py: using BVCI 33551 11:12:52.976438 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:12:52.988004 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:12:52.999428 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:12:53.010793 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:12:53.022498 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:12:53.034289 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:12:53.152596 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:12:53.270545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:53.763131 run create_hlr_db(pid=12877): Launched 11:12:53.884421 bus /sierra_2: Setting Powered False 11:12:54.946941 run create_hlr_db(pid=12877): Terminated: ok {rc=0} 11:12:55.370963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12879): Launched 11:12:55.667975 run osmo-hlr_10.42.42.2(pid=12880): Launched 11:12:55.780646 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:56.306224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12882): Launched 11:12:56.604688 run osmo-stp_10.42.42.5(pid=12883): Launched 11:12:56.717064 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:57.253204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12885): Launched 11:12:57.550011 run osmo-msc_10.42.42.6(pid=12886): Launched 11:12:57.716161 run osmo-stp_10.42.42.5(pid=12883): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12883)] 11:12:57.842244 run osmo-stp_10.42.42.5(pid=12883): stdout: | (launched: 2022-12-13_11:12:56.549846) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:57.968348 run osmo-stp_10.42.42.5(pid=12883): stderr: | 20221213111256721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111256721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111256721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111256722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111256724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111256724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111256724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:58.092031 run osmo-stp_10.42.42.5(pid=12883): stdout: | (launched: 2022-12-13_11:12:56.549846) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:58.210139 run osmo-stp_10.42.42.5(pid=12883): stderr: | 20221213111256721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111256721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111256721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111256722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111256724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111256724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111256724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:58.351083 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12883): Process ended prematurely: osmo-stp_10.42.42.5(pid=12883) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12883)] [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:12:58.359828 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 11:12:58.386065 run osmo-hlr_10.42.42.2(pid=12880): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12880)] 11:12:58.433538 run osmo-hlr_10.42.42.2(pid=12880): stdout: | (launched: 2022-12-13_11:12:55.613440) 11:12:58.482091 run osmo-hlr_10.42.42.2(pid=12880): stderr: | 20221213111255790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111255790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111255790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111255790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111255790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111255790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111255803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111255811 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111255812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111255812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:58.549890 run osmo-msc_10.42.42.6(pid=12886): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12886)] 11:12:58.596532 run osmo-msc_10.42.42.6(pid=12886): stdout: | (launched: 2022-12-13_11:12:57.495542) 11:12:58.644821 run osmo-msc_10.42.42.6(pid=12886): stderr: | 20221213111257764 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111257764 DLGLOBAL DEBUG validating counter group 0x7fef98cdfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111257764 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111257764 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111257764 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111257764 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111257766 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111257767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111257767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111257767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:58.693497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12879): Terminating (SIGTERM) 11:12:58.732387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12882): Terminating (SIGTERM) 11:12:58.771318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12885): Terminating (SIGTERM) 11:12:58.810622 --- ParallelTerminationStrategy: PID 12879 died... 11:12:58.829466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12879): Terminated: ok {rc=0} 11:12:58.872755 --- ParallelTerminationStrategy: PID 12882 died... 11:12:58.891139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12882): Terminated: ok {rc=0} 11:12:58.934348 --- ParallelTerminationStrategy: PID 12885 died... 11:12:58.952630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12885): Terminated: ok {rc=0} 11:12:59.034567 bus /sierra_3: Setting Powered False 11:13:00.131032 bus /sierra_3: Setting Powered False 11:13:01.255207 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:13:02.418541 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:13:02.430983 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:13:02.503426 tst mo_mt_call_osmux.py: using LAC 33551 11:13:02.627282 tst mo_mt_call_osmux.py: using RAC 146 11:13:02.752266 tst mo_mt_call_osmux.py: using CellId 33551 11:13:02.874559 tst mo_mt_call_osmux.py: using BVCI 33552 11:13:02.990359 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:13:03.002031 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:13:03.013335 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:13:03.024477 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:13:03.036244 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:13:03.047894 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:13:03.163606 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:13:03.284601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:03.779950 run create_hlr_db(pid=12889): Launched 11:13:03.901508 bus /sierra_2: Setting Powered False 11:13:04.965224 run create_hlr_db(pid=12889): Terminated: ok {rc=0} 11:13:05.409346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12891): Launched 11:13:05.728546 run osmo-hlr_10.42.42.2(pid=12892): Launched 11:13:05.851317 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:06.402527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12894): Launched 11:13:06.721009 run osmo-stp_10.42.42.5(pid=12895): Launched 11:13:06.843040 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:07.420221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12897): Launched 11:13:07.740017 run osmo-msc_10.42.42.6(pid=12898): Launched 11:13:07.919009 run osmo-stp_10.42.42.5(pid=12895): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12895)] 11:13:08.054338 run osmo-stp_10.42.42.5(pid=12895): stdout: | (launched: 2022-12-13_11:13:06.663138) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:08.189905 run osmo-stp_10.42.42.5(pid=12895): stderr: | 20221213111306854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111306854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111306854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111306855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111306855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111306855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111306855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:08.324771 run osmo-stp_10.42.42.5(pid=12895): stdout: | (launched: 2022-12-13_11:13:06.663138) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:08.452337 run osmo-stp_10.42.42.5(pid=12895): stderr: | 20221213111306854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111306854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111306854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111306855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111306855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111306855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111306855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:08.605136 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12895): Process ended prematurely: osmo-stp_10.42.42.5(pid=12895) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12895)] [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:13:08.614616 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:13:08.642062 run osmo-hlr_10.42.42.2(pid=12892): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12892)] 11:13:08.692382 run osmo-hlr_10.42.42.2(pid=12892): stdout: | (launched: 2022-12-13_11:13:05.670331) 11:13:08.743996 run osmo-hlr_10.42.42.2(pid=12892): stderr: | 20221213111305869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111305869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111305869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111305869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111305869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111305869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111305882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111305890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111305890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111305890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:08.816462 run osmo-msc_10.42.42.6(pid=12898): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12898)] 11:13:08.865949 run osmo-msc_10.42.42.6(pid=12898): stdout: | (launched: 2022-12-13_11:13:07.681767) 11:13:08.917757 run osmo-msc_10.42.42.6(pid=12898): stderr: | 20221213111308001 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111308001 DLGLOBAL DEBUG validating counter group 0x7fb987719c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111308001 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111308001 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111308001 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111308002 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111308003 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111308004 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111308004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111308004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:08.969736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12891): Terminating (SIGTERM) 11:13:09.011528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12894): Terminating (SIGTERM) 11:13:09.053392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12897): Terminating (SIGTERM) 11:13:09.096003 --- ParallelTerminationStrategy: PID 12891 died... 11:13:09.116484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12891): Terminated: ok {rc=0} 11:13:09.162885 --- ParallelTerminationStrategy: PID 12894 died... 11:13:09.182742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12894): Terminated: ok {rc=0} 11:13:09.229053 --- ParallelTerminationStrategy: PID 12897 died... 11:13:09.248890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12897): Terminated: ok {rc=0} 11:13:09.335763 bus /sierra_3: Setting Powered False 11:13:10.434110 bus /sierra_3: Setting Powered False 11:13:11.547992 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:13:12.789623 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:12.796756 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:13:12.828226 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:13:12.854602 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:13:12.905071 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:13:12.936712 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:13:12.963852 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:13:13.513492 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:13:13.563578 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:13:13.574750 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:13:13.641503 tst mo_mt_call.py: using LAC 33552 11:13:13.776450 tst mo_mt_call.py: using RAC 147 11:13:13.901370 tst mo_mt_call.py: using CellId 33552 11:13:14.025238 tst mo_mt_call.py: using BVCI 33553 11:13:14.143017 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:13:14.154780 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:13:14.166485 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:13:14.177890 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:13:14.189714 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:13:14.201476 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:13:14.317256 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:13:14.431176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:14.891892 run create_hlr_db(pid=12903): Launched 11:13:15.014077 bus /sierra_2: Setting Powered False 11:13:16.076408 run create_hlr_db(pid=12903): Terminated: ok {rc=0} 11:13:16.533965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12905): Launched 11:13:16.878262 run osmo-hlr_10.42.42.2(pid=12906): Launched 11:13:17.173729 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:17.707541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12908): Launched 11:13:18.004319 run osmo-stp_10.42.42.5(pid=12909): Launched 11:13:18.117139 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:18.653997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12911): Launched 11:13:18.950611 run osmo-msc_10.42.42.6(pid=12912): Launched 11:13:19.114942 run osmo-stp_10.42.42.5(pid=12909): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12909)] 11:13:19.240201 run osmo-stp_10.42.42.5(pid=12909): stdout: | (launched: 2022-12-13_11:13:17.949688) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:19.365621 run osmo-stp_10.42.42.5(pid=12909): stderr: | 20221213111318119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111318119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111318119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111318120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111318120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111318121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111318121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:19.488870 run osmo-stp_10.42.42.5(pid=12909): stdout: | (launched: 2022-12-13_11:13:17.949688) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:19.606736 run osmo-stp_10.42.42.5(pid=12909): stderr: | 20221213111318119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111318119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111318119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111318120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111318120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111318121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111318121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:19.747850 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12909): Process ended prematurely: osmo-stp_10.42.42.5(pid=12909) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12909)] [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:13:19.756485 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:13:19.782388 run osmo-hlr_10.42.42.2(pid=12906): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12906)] 11:13:19.829573 run osmo-hlr_10.42.42.2(pid=12906): stdout: | (launched: 2022-12-13_11:13:16.812134) 11:13:19.877972 run osmo-hlr_10.42.42.2(pid=12906): stderr: | 20221213111317015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111317016 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111317016 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111317016 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111317016 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111317016 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111317032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111317050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111317050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111317051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:19.946103 run osmo-msc_10.42.42.6(pid=12912): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12912)] 11:13:19.993066 run osmo-msc_10.42.42.6(pid=12912): stdout: | (launched: 2022-12-13_11:13:18.896157) 11:13:20.041656 run osmo-msc_10.42.42.6(pid=12912): stderr: | 20221213111319165 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111319166 DLGLOBAL DEBUG validating counter group 0x7ff1aa0d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111319166 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111319166 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111319166 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111319166 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111319168 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111319168 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111319168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111319168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:20.090524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12905): Terminating (SIGTERM) 11:13:20.129432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12908): Terminating (SIGTERM) 11:13:20.168449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12911): Terminating (SIGTERM) 11:13:20.207838 --- ParallelTerminationStrategy: PID 12905 died... 11:13:20.226787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12905): Terminated: ok {rc=0} 11:13:20.270250 --- ParallelTerminationStrategy: PID 12908 died... 11:13:20.288608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12908): Terminated: ok {rc=0} 11:13:20.331740 --- ParallelTerminationStrategy: PID 12911 died... 11:13:20.350095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12911): Terminated: ok {rc=0} 11:13:20.434574 bus /sierra_3: Setting Powered False 11:13:21.531791 bus /sierra_3: Setting Powered False 11:13:22.644716 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:13:23.787892 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:13:23.799338 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:13:23.864808 tst mo_mt_call_osmux.py: using LAC 33553 11:13:23.982994 tst mo_mt_call_osmux.py: using RAC 148 11:13:24.101366 tst mo_mt_call_osmux.py: using CellId 33553 11:13:24.228546 tst mo_mt_call_osmux.py: using BVCI 33554 11:13:24.346685 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:13:24.358425 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:13:24.369947 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:13:24.381274 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:13:24.393242 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:13:24.404757 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:13:24.525286 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:13:24.646709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:25.107276 run create_hlr_db(pid=12914): Launched 11:13:25.228628 bus /sierra_2: Setting Powered False 11:13:26.287156 run create_hlr_db(pid=12914): Terminated: ok {rc=0} 11:13:26.702498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12916): Launched 11:13:26.999387 run osmo-hlr_10.42.42.2(pid=12917): Launched 11:13:27.111301 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:27.636796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12919): Launched 11:13:27.934083 run osmo-stp_10.42.42.5(pid=12920): Launched 11:13:28.047652 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:28.585213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12922): Launched 11:13:28.884039 run osmo-msc_10.42.42.6(pid=12923): Launched 11:13:29.050367 run osmo-stp_10.42.42.5(pid=12920): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12920)] 11:13:29.176405 run osmo-stp_10.42.42.5(pid=12920): stdout: | (launched: 2022-12-13_11:13:27.879031) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:29.302144 run osmo-stp_10.42.42.5(pid=12920): stderr: | 20221213111328050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111328050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111328051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111328051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111328051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111328051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111328052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:29.426231 run osmo-stp_10.42.42.5(pid=12920): stdout: | (launched: 2022-12-13_11:13:27.879031) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:29.544501 run osmo-stp_10.42.42.5(pid=12920): stderr: | 20221213111328050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111328050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111328051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111328051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111328051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111328051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111328052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:29.686296 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12920): Process ended prematurely: osmo-stp_10.42.42.5(pid=12920) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12920)] [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:13:29.695005 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 11:13:29.721082 run osmo-hlr_10.42.42.2(pid=12917): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12917)] 11:13:29.768094 run osmo-hlr_10.42.42.2(pid=12917): stdout: | (launched: 2022-12-13_11:13:26.944878) 11:13:29.817698 run osmo-hlr_10.42.42.2(pid=12917): stderr: | 20221213111327119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111327119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111327119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111327119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111327119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111327119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111327131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111327140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111327140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111327140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:29.886411 run osmo-msc_10.42.42.6(pid=12923): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12923)] 11:13:29.933740 run osmo-msc_10.42.42.6(pid=12923): stdout: | (launched: 2022-12-13_11:13:28.829317) 11:13:29.982569 run osmo-msc_10.42.42.6(pid=12923): stderr: | 20221213111329098 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111329098 DLGLOBAL DEBUG validating counter group 0x7f73dd775c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111329098 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111329098 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111329098 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111329099 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111329100 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111329101 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111329101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111329101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:30.031753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12916): Terminating (SIGTERM) 11:13:30.071036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12919): Terminating (SIGTERM) 11:13:30.110401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12922): Terminating (SIGTERM) 11:13:30.149835 --- ParallelTerminationStrategy: PID 12916 died... 11:13:30.168879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12916): Terminated: ok {rc=0} 11:13:30.212297 --- ParallelTerminationStrategy: PID 12919 died... 11:13:30.230706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12919): Terminated: ok {rc=0} 11:13:30.273801 --- ParallelTerminationStrategy: PID 12922 died... 11:13:30.291972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12922): Terminated: ok {rc=0} 11:13:30.374370 bus /sierra_3: Setting Powered False 11:13:31.475574 bus /sierra_3: Setting Powered False 11:13:32.600203 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:13:33.851302 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:33.859220 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:13:33.892270 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:13:33.921545 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:13:33.972093 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:13:34.004101 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:13:34.030745 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:13:34.581985 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:13:34.630685 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:13:34.641933 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:13:34.709522 tst mo_mt_call.py: using LAC 33554 11:13:34.827710 tst mo_mt_call.py: using RAC 149 11:13:34.945707 tst mo_mt_call.py: using CellId 33554 11:13:35.062593 tst mo_mt_call.py: using BVCI 33555 11:13:35.169818 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:13:35.181024 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:13:35.191961 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:13:35.202919 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:13:35.214532 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:13:35.226058 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:13:35.345808 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:13:35.462856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:35.921126 run create_hlr_db(pid=12928): Launched 11:13:36.041829 bus /sierra_2: Setting Powered False 11:13:37.101667 run create_hlr_db(pid=12928): Terminated: ok {rc=0} 11:13:37.536026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12930): Launched 11:13:37.854567 run osmo-hlr_10.42.42.2(pid=12931): Launched 11:13:37.977423 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:38.523668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12933): Launched 11:13:38.843501 run osmo-stp_10.42.42.5(pid=12934): Launched 11:13:38.966252 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:39.543833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12936): Launched 11:13:39.862447 run osmo-msc_10.42.42.6(pid=12937): Launched 11:13:40.040678 run osmo-stp_10.42.42.5(pid=12934): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12934)] 11:13:40.179538 run osmo-stp_10.42.42.5(pid=12934): stdout: | (launched: 2022-12-13_11:13:38.785361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:40.311252 run osmo-stp_10.42.42.5(pid=12934): stderr: | 20221213111338975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111338976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111338976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111338976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111338977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111338977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111338977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:40.444218 run osmo-stp_10.42.42.5(pid=12934): stdout: | (launched: 2022-12-13_11:13:38.785361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:40.571577 run osmo-stp_10.42.42.5(pid=12934): stderr: | 20221213111338975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111338976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111338976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111338976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111338977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111338977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111338977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:40.723843 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12934): Process ended prematurely: osmo-stp_10.42.42.5(pid=12934) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12934)] [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:13:40.733443 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:13:40.761015 run osmo-hlr_10.42.42.2(pid=12931): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12931)] 11:13:40.811193 run osmo-hlr_10.42.42.2(pid=12931): stdout: | (launched: 2022-12-13_11:13:37.796595) 11:13:40.862669 run osmo-hlr_10.42.42.2(pid=12931): stderr: | 20221213111337995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111337995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111337995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111337995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111337995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111337995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111338008 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111338016 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111338016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111338016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:40.935446 run osmo-msc_10.42.42.6(pid=12937): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12937)] 11:13:40.985136 run osmo-msc_10.42.42.6(pid=12937): stdout: | (launched: 2022-12-13_11:13:39.804271) 11:13:41.036501 run osmo-msc_10.42.42.6(pid=12937): stderr: | 20221213111340126 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111340126 DLGLOBAL DEBUG validating counter group 0x7fc886fddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111340126 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111340126 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111340126 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111340126 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111340128 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111340128 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111340129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111340129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:41.088059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12930): Terminating (SIGTERM) 11:13:41.129740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12933): Terminating (SIGTERM) 11:13:41.171934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12936): Terminating (SIGTERM) 11:13:41.214049 --- ParallelTerminationStrategy: PID 12930 died... 11:13:41.234263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12930): Terminated: ok {rc=0} 11:13:41.280184 --- ParallelTerminationStrategy: PID 12933 died... 11:13:41.299866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12933): Terminated: ok {rc=0} 11:13:41.345744 --- ParallelTerminationStrategy: PID 12936 died... 11:13:41.365465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12936): Terminated: ok {rc=0} 11:13:41.452505 bus /sierra_3: Setting Powered False 11:13:42.549508 bus /sierra_3: Setting Powered False 11:13:43.662720 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:13:44.806869 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:13:44.818749 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:13:44.885087 tst mo_mt_call_osmux.py: using LAC 33555 11:13:45.001333 tst mo_mt_call_osmux.py: using RAC 150 11:13:45.117959 tst mo_mt_call_osmux.py: using CellId 33555 11:13:45.234773 tst mo_mt_call_osmux.py: using BVCI 33556 11:13:45.342378 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:13:45.353470 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:13:45.364283 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:13:45.375134 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:13:45.386069 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:13:45.396804 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:13:45.516865 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:13:45.631675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:46.103192 run create_hlr_db(pid=12939): Launched 11:13:46.255970 bus /sierra_2: Setting Powered False 11:13:47.322478 run create_hlr_db(pid=12939): Terminated: ok {rc=0} 11:13:47.750182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12941): Launched 11:13:48.048681 run osmo-hlr_10.42.42.2(pid=12942): Launched 11:13:48.161574 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:48.672312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12944): Launched 11:13:48.970394 run osmo-stp_10.42.42.5(pid=12945): Launched 11:13:49.083072 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:49.619777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12947): Launched 11:13:49.917294 run osmo-msc_10.42.42.6(pid=12948): Launched 11:13:50.083112 run osmo-stp_10.42.42.5(pid=12945): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12945)] 11:13:50.216614 run osmo-stp_10.42.42.5(pid=12945): stdout: | (launched: 2022-12-13_11:13:48.915938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:50.356809 run osmo-stp_10.42.42.5(pid=12945): stderr: | 20221213111349086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111349086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111349087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111349087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111349087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111349088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111349088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:50.480244 run osmo-stp_10.42.42.5(pid=12945): stdout: | (launched: 2022-12-13_11:13:48.915938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:50.598374 run osmo-stp_10.42.42.5(pid=12945): stderr: | 20221213111349086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111349086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111349087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111349087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111349087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111349088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111349088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:50.739482 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12945): Process ended prematurely: osmo-stp_10.42.42.5(pid=12945) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12945)] [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:13:50.748364 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 11:13:50.774582 run osmo-hlr_10.42.42.2(pid=12942): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12942)] 11:13:50.822260 run osmo-hlr_10.42.42.2(pid=12942): stdout: | (launched: 2022-12-13_11:13:47.994215) 11:13:50.870825 run osmo-hlr_10.42.42.2(pid=12942): stderr: | 20221213111348170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111348170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111348170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111348170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111348170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111348170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111348185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111348193 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111348194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111348194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:50.938766 run osmo-msc_10.42.42.6(pid=12948): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12948)] 11:13:50.985578 run osmo-msc_10.42.42.6(pid=12948): stdout: | (launched: 2022-12-13_11:13:49.861660) 11:13:51.034037 run osmo-msc_10.42.42.6(pid=12948): stderr: | 20221213111350130 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111350130 DLGLOBAL DEBUG validating counter group 0x7fc1e2b93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111350130 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111350130 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111350131 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111350131 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111350132 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111350133 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111350133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111350133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:51.083130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12941): Terminating (SIGTERM) 11:13:51.122452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12944): Terminating (SIGTERM) 11:13:51.161812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12947): Terminating (SIGTERM) 11:13:51.201541 --- ParallelTerminationStrategy: PID 12941 died... 11:13:51.220607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12941): Terminated: ok {rc=0} 11:13:51.264114 --- ParallelTerminationStrategy: PID 12944 died... 11:13:51.282726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12944): Terminated: ok {rc=0} 11:13:51.326060 --- ParallelTerminationStrategy: PID 12947 died... 11:13:51.344714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12947): Terminated: ok {rc=0} 11:13:51.429215 bus /sierra_3: Setting Powered False 11:13:52.527434 bus /sierra_3: Setting Powered False 11:13:53.639661 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:13:54.886200 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:54.893500 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:13:54.925075 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:13:54.951594 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:13:55.001729 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:13:55.033854 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:13:55.060479 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:13:55.610455 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:13:55.659369 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:13:55.670679 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:13:55.736756 tst mo_mt_call.py: using LAC 33556 11:13:55.859739 tst mo_mt_call.py: using RAC 151 11:13:55.985788 tst mo_mt_call.py: using CellId 33556 11:13:56.111982 tst mo_mt_call.py: using BVCI 33557 11:13:56.228807 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:13:56.240468 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:13:56.252056 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:13:56.263733 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:13:56.275468 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:13:56.287111 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:13:56.404706 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:13:56.523315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:56.985470 run create_hlr_db(pid=12953): Launched 11:13:57.106310 bus /sierra_2: Setting Powered False 11:13:58.165497 run create_hlr_db(pid=12953): Terminated: ok {rc=0} 11:13:58.578856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12956): Launched 11:13:58.875473 run osmo-hlr_10.42.42.2(pid=12957): Launched 11:13:58.987995 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:59.512832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12959): Launched 11:13:59.810134 run osmo-stp_10.42.42.5(pid=12960): Launched 11:13:59.923395 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:00.459542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12962): Launched 11:14:00.755326 run osmo-msc_10.42.42.6(pid=12963): Launched 11:14:01.004058 run osmo-stp_10.42.42.5(pid=12960): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12960)] 11:14:01.276113 run osmo-stp_10.42.42.5(pid=12960): stdout: | (launched: 2022-12-13_11:13:59.755652) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:01.411950 run osmo-stp_10.42.42.5(pid=12960): stderr: | 20221213111359927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111359927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111359927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111359928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111359928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111359928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111359928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:01.541389 run osmo-stp_10.42.42.5(pid=12960): stdout: | (launched: 2022-12-13_11:13:59.755652) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:01.664010 run osmo-stp_10.42.42.5(pid=12960): stderr: | 20221213111359927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111359927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111359927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111359928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111359928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111359928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111359928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:01.808380 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12960): Process ended prematurely: osmo-stp_10.42.42.5(pid=12960) [trial-2388↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12960)] [trial-2388↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:14:01.818128 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:14:01.845726 run osmo-hlr_10.42.42.2(pid=12957): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12957)] 11:14:01.894103 run osmo-hlr_10.42.42.2(pid=12957): stdout: | (launched: 2022-12-13_11:13:58.820732) 11:14:01.944397 run osmo-hlr_10.42.42.2(pid=12957): stderr: | 20221213111358997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111358997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111358997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111358997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111358997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111358997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111359009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111359018 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111359018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111359018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:02.014753 run osmo-msc_10.42.42.6(pid=12963): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12963)] 11:14:02.062723 run osmo-msc_10.42.42.6(pid=12963): stdout: | (launched: 2022-12-13_11:14:00.700685) 11:14:02.112236 run osmo-msc_10.42.42.6(pid=12963): stderr: | 20221213111401062 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111401062 DLGLOBAL DEBUG validating counter group 0x7fe46e495c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111401062 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111401062 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111401063 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111401063 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111401065 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111401065 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111401065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111401065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:02.162368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12956): Terminating (SIGTERM) 11:14:02.202441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12959): Terminating (SIGTERM) 11:14:02.242277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12962): Terminating (SIGTERM) 11:14:02.282702 --- ParallelTerminationStrategy: PID 12956 died... 11:14:02.301746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12956): Terminated: ok {rc=0} 11:14:02.345705 --- ParallelTerminationStrategy: PID 12959 died... 11:14:02.364707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12959): Terminated: ok {rc=0} 11:14:02.408659 --- ParallelTerminationStrategy: PID 12962 died... 11:14:02.427247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12962): Terminated: ok {rc=0} 11:14:02.511736 bus /sierra_3: Setting Powered False 11:14:03.610908 bus /sierra_3: Setting Powered False 11:14:04.725830 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:14:05.870189 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:14:05.882135 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:14:05.948768 tst mo_mt_call_osmux.py: using LAC 33557 11:14:06.065742 tst mo_mt_call_osmux.py: using RAC 152 11:14:06.184328 tst mo_mt_call_osmux.py: using CellId 33557 11:14:06.301472 tst mo_mt_call_osmux.py: using BVCI 33558 11:14:06.408497 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:14:06.419704 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:14:06.430685 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:14:06.441583 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:14:06.452627 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:14:06.463600 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:14:06.585679 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:14:06.706751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:07.205473 run create_hlr_db(pid=12965): Launched 11:14:07.327012 bus /sierra_2: Setting Powered False 11:14:08.390114 run create_hlr_db(pid=12965): Terminated: ok {rc=0} 11:14:08.816025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12967): Launched 11:14:09.114276 run osmo-hlr_10.42.42.2(pid=12968): Launched 11:14:09.226467 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:09.751173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12970): Launched 11:14:10.047866 run osmo-stp_10.42.42.5(pid=12971): Launched 11:14:10.160070 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:10.696941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12973): Launched 11:14:10.994498 run osmo-msc_10.42.42.6(pid=12974): Launched 11:14:11.160781 run osmo-stp_10.42.42.5(pid=12971): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12971)] 11:14:11.286268 run osmo-stp_10.42.42.5(pid=12971): stdout: | (launched: 2022-12-13_11:14:09.993192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:11.412096 run osmo-stp_10.42.42.5(pid=12971): stderr: | 20221213111410163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111410163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111410163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111410164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111410164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111410164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111410164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:11.535529 run osmo-stp_10.42.42.5(pid=12971): stdout: | (launched: 2022-12-13_11:14:09.993192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:11.653658 run osmo-stp_10.42.42.5(pid=12971): stderr: | 20221213111410163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111410163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111410163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111410164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111410164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111410164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111410164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:11.794894 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12971): Process ended prematurely: osmo-stp_10.42.42.5(pid=12971) [trial-2388↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12971)] [trial-2388↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:14:11.803678 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 11:14:11.829768 run osmo-hlr_10.42.42.2(pid=12968): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12968)] 11:14:11.877295 run osmo-hlr_10.42.42.2(pid=12968): stdout: | (launched: 2022-12-13_11:14:09.059552) 11:14:11.936686 run osmo-hlr_10.42.42.2(pid=12968): stderr: | 20221213111409234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111409234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111409234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111409234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111409234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111409234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111409246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111409255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111409255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111409255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:12.009681 run osmo-msc_10.42.42.6(pid=12974): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12974)] 11:14:12.057530 run osmo-msc_10.42.42.6(pid=12974): stdout: | (launched: 2022-12-13_11:14:10.938875) 11:14:12.106583 run osmo-msc_10.42.42.6(pid=12974): stderr: | 20221213111411207 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111411207 DLGLOBAL DEBUG validating counter group 0x7fe34aabec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111411208 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111411208 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111411208 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111411208 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111411210 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111411210 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111411210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111411210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:12.156071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12967): Terminating (SIGTERM) 11:14:12.195257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12970): Terminating (SIGTERM) 11:14:12.234536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12973): Terminating (SIGTERM) 11:14:12.274116 --- ParallelTerminationStrategy: PID 12967 died... 11:14:12.293153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12967): Terminated: ok {rc=0} 11:14:12.337050 --- ParallelTerminationStrategy: PID 12970 died... 11:14:12.355696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12970): Terminated: ok {rc=0} 11:14:12.399725 --- ParallelTerminationStrategy: PID 12973 died... 11:14:12.418524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12973): Terminated: ok {rc=0} 11:14:12.503908 bus /sierra_3: Setting Powered False 11:14:13.602273 bus /sierra_3: Setting Powered False 11:14:14.714162 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:14:15.972574 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:14:15.982803 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:14:16.028940 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 11:14:16.055883 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 11:14:16.107815 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:14:16.140578 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 11:14:16.168214 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 11:14:16.721675 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 11:14:16.787446 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:14:16.801647 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:14:16.858456 tst mo_mt_call.py: using LAC 33558 11:14:17.011000 tst mo_mt_call.py: using RAC 153 11:14:17.144745 tst mo_mt_call.py: using CellId 33558 11:14:17.271267 tst mo_mt_call.py: using BVCI 33559 11:14:17.391676 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:14:17.403878 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:14:17.416009 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:14:17.427998 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:14:17.440865 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:14:17.453259 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:14:17.573282 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:14:17.689544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:18.151180 run create_hlr_db(pid=12979): Launched 11:14:18.272449 bus /sierra_2: Setting Powered False 11:14:19.332338 run create_hlr_db(pid=12979): Terminated: ok {rc=0} 11:14:19.770184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12981): Launched 11:14:20.091305 run osmo-hlr_10.42.42.2(pid=12982): Launched 11:14:20.213276 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:20.766584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12984): Launched 11:14:21.086632 run osmo-stp_10.42.42.5(pid=12985): Launched 11:14:21.208534 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:21.785774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12987): Launched 11:14:22.104643 run osmo-msc_10.42.42.6(pid=12988): Launched 11:14:22.282150 run osmo-stp_10.42.42.5(pid=12985): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12985)] 11:14:22.417028 run osmo-stp_10.42.42.5(pid=12985): stdout: | (launched: 2022-12-13_11:14:21.028239) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:22.552065 run osmo-stp_10.42.42.5(pid=12985): stderr: | 20221213111421219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111421219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111421220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111421220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111421221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111421221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111421221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:22.686693 run osmo-stp_10.42.42.5(pid=12985): stdout: | (launched: 2022-12-13_11:14:21.028239) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:22.814067 run osmo-stp_10.42.42.5(pid=12985): stderr: | 20221213111421219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111421219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111421220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111421220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111421221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111421221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111421221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:22.966807 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12985): Process ended prematurely: osmo-stp_10.42.42.5(pid=12985) [trial-2388↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12985)] [trial-2388↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 11:14:22.976051 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:14:23.003489 run osmo-hlr_10.42.42.2(pid=12982): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12982)] 11:14:23.053728 run osmo-hlr_10.42.42.2(pid=12982): stdout: | (launched: 2022-12-13_11:14:20.033009) 11:14:23.105858 run osmo-hlr_10.42.42.2(pid=12982): stderr: | 20221213111420231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111420231 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111420231 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111420231 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111420231 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111420231 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111420247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111420256 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111420256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111420256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:23.177667 run osmo-msc_10.42.42.6(pid=12988): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12988)] 11:14:23.227023 run osmo-msc_10.42.42.6(pid=12988): stdout: | (launched: 2022-12-13_11:14:22.046230) 11:14:23.277992 run osmo-msc_10.42.42.6(pid=12988): stderr: | 20221213111422367 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111422367 DLGLOBAL DEBUG validating counter group 0x7f8744a9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111422367 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111422367 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111422367 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111422368 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111422370 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111422370 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111422370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111422370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:23.329748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12981): Terminating (SIGTERM) 11:14:23.371387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12984): Terminating (SIGTERM) 11:14:23.413595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12987): Terminating (SIGTERM) 11:14:23.456021 --- ParallelTerminationStrategy: PID 12981 died... 11:14:23.476340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12981): Terminated: ok {rc=0} 11:14:23.522602 --- ParallelTerminationStrategy: PID 12984 died... 11:14:23.542404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12984): Terminated: ok {rc=0} 11:14:23.588481 --- ParallelTerminationStrategy: PID 12987 died... 11:14:23.608392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12987): Terminated: ok {rc=0} 11:14:23.696733 bus /sierra_3: Setting Powered False 11:14:24.794814 bus /sierra_3: Setting Powered False 11:14:25.909065 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 11:14:27.057258 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:14:27.069590 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:14:27.120573 tst mo_mt_call_osmux.py: using LAC 33559 11:14:27.242794 tst mo_mt_call_osmux.py: using RAC 154 11:14:27.361351 tst mo_mt_call_osmux.py: using CellId 33559 11:14:27.476829 tst mo_mt_call_osmux.py: using BVCI 33560 11:14:27.584748 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:14:27.596434 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:14:27.607718 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:14:27.618690 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:14:27.629928 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:14:27.641160 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:14:27.761128 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:14:27.879281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:28.341347 run create_hlr_db(pid=12990): Launched 11:14:28.462879 bus /sierra_2: Setting Powered False 11:14:29.523037 run create_hlr_db(pid=12990): Terminated: ok {rc=0} 11:14:29.961254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12992): Launched 11:14:30.280838 run osmo-hlr_10.42.42.2(pid=12993): Launched 11:14:30.403240 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:30.977805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12995): Launched 11:14:31.317673 run osmo-stp_10.42.42.5(pid=12996): Launched 11:14:31.600525 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:32.193686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12998): Launched 11:14:32.522237 run osmo-msc_10.42.42.6(pid=12999): Launched 11:14:32.703130 run osmo-stp_10.42.42.5(pid=12996): ERR: Terminated: ERROR {rc=1} [trial-2388↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12996)] 11:14:32.839783 run osmo-stp_10.42.42.5(pid=12996): stdout: | (launched: 2022-12-13_11:14:31.248866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:32.977768 run osmo-stp_10.42.42.5(pid=12996): stderr: | 20221213111431445 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111431445 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111431445 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111431446 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111431448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111431448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111431448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:33.113848 run osmo-stp_10.42.42.5(pid=12996): stdout: | (launched: 2022-12-13_11:14:31.248866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:33.242594 run osmo-stp_10.42.42.5(pid=12996): stderr: | 20221213111431445 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111431445 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111431445 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111431446 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111431448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111431448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111431448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:33.396516 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12996): Process ended prematurely: osmo-stp_10.42.42.5(pid=12996) [trial-2388↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12996)] [trial-2388↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 11:14:33.406277 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:14:33.433975 run osmo-hlr_10.42.42.2(pid=12993): ERR: Terminated: ERROR {rc=237} [trial-2388↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12993)] 11:14:33.485283 run osmo-hlr_10.42.42.2(pid=12993): stdout: | (launched: 2022-12-13_11:14:30.222663) 11:14:33.537839 run osmo-hlr_10.42.42.2(pid=12993): stderr: | 20221213111430425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111430425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111430425 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111430425 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111430425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111430425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111430438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111430446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111430447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111430447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:33.610613 run osmo-msc_10.42.42.6(pid=12999): ERR: Terminated: ERROR {rc=2} [trial-2388↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12999)] 11:14:33.660765 run osmo-msc_10.42.42.6(pid=12999): stdout: | (launched: 2022-12-13_11:14:32.463817) 11:14:33.713255 run osmo-msc_10.42.42.6(pid=12999): stderr: | 20221213111432781 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111432781 DLGLOBAL DEBUG validating counter group 0x7f9175adcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111432781 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111432782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111432782 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111432782 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111432783 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111432784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111432784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111432784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:33.766363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12992): Terminating (SIGTERM) 11:14:33.808558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12995): Terminating (SIGTERM) 11:14:33.851634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12998): Terminating (SIGTERM) 11:14:33.894827 --- ParallelTerminationStrategy: PID 12992 died... 11:14:33.915320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12992): Terminated: ok {rc=0} 11:14:33.962704 --- ParallelTerminationStrategy: PID 12995 died... 11:14:33.982961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12995): Terminated: ok {rc=0} 11:14:34.029801 --- ParallelTerminationStrategy: PID 12998 died... 11:14:34.050026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12998): Terminated: ok {rc=0} 11:14:34.138939 bus /sierra_3: Setting Powered False 11:14:35.237747 bus /sierra_3: Setting Powered False 11:14:36.355238 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 emergency:nanobts+band-900 --------------------------------------------------------------------- 11:14:37.610504 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:14:37.615610 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 11:14:37.646764 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 11:14:37.672882 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 11:14:37.755315 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 11:14:37.786449 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 11:14:37.812608 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 11:14:38.395429 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2388 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 11:14:38.400341 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:14:38.410944 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 11:14:38.457166 tst emergency_mo_mt_call.py: using LAC 33560 11:14:38.571359 tst emergency_mo_mt_call.py: using RAC 155 11:14:38.699692 tst emergency_mo_mt_call.py: using CellId 33560 11:14:38.821671 tst emergency_mo_mt_call.py: using BVCI 33561 11:14:38.935212 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:14:38.946520 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:14:38.957662 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:14:38.968438 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:14:38.979844 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:14:38.991116 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 11:14:39.106530 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 11:14:39.224311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:39.711360 run create_hlr_db(pid=13004): Launched 11:14:39.831134 bus /sierra_2: Setting Powered False 11:14:40.893441 run create_hlr_db(pid=13004): Terminated: ok {rc=0} 11:14:41.333298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13006): Launched 11:14:41.647768 run osmo-hlr_10.42.42.2(pid=13007): Launched 11:14:41.768192 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:42.312482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13009): Launched 11:14:42.625124 run osmo-stp_10.42.42.5(pid=13010): Launched 11:14:42.754770 tst emergency_mo_mt_call.py: using MSISDN 8121 11:14:42.916480 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:43.481485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13012): Launched 11:14:43.793660 run osmo-msc_10.42.42.6(pid=13013): Launched 11:14:43.969263 run osmo-stp_10.42.42.5(pid=13010): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13010)] 11:14:44.102133 run osmo-stp_10.42.42.5(pid=13010): stdout: | (launched: 2022-12-13_11:14:42.567989) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:44.235742 run osmo-stp_10.42.42.5(pid=13010): stderr: | 20221213111442758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111442758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111442759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111442759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111442760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111442760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111442760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:44.368704 run osmo-stp_10.42.42.5(pid=13010): stdout: | (launched: 2022-12-13_11:14:42.567989) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:44.494387 run osmo-stp_10.42.42.5(pid=13010): stderr: | 20221213111442758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111442758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111442759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111442759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111442760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111442760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111442760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:44.644182 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13010): Process ended prematurely: osmo-stp_10.42.42.5(pid=13010) [trial-2388↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13010)] [trial-2388↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 11:14:44.653316 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 11:14:44.680429 run osmo-hlr_10.42.42.2(pid=13007): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13007)] 11:14:44.730946 run osmo-hlr_10.42.42.2(pid=13007): stdout: | (launched: 2022-12-13_11:14:41.590049) 11:14:44.782705 run osmo-hlr_10.42.42.2(pid=13007): stderr: | 20221213111441788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111441789 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111441789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111441789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111441789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111441789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111441801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111441809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111441810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111441810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:44.855122 run osmo-msc_10.42.42.6(pid=13013): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13013)] 11:14:44.904837 run osmo-msc_10.42.42.6(pid=13013): stdout: | (launched: 2022-12-13_11:14:43.736101) 11:14:44.956859 run osmo-msc_10.42.42.6(pid=13013): stderr: | 20221213111444054 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111444055 DLGLOBAL DEBUG validating counter group 0x7f0a8bb94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111444055 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111444055 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111444055 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111444055 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111444057 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111444057 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111444058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111444058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:45.009006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13006): Terminating (SIGTERM) 11:14:45.050764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13009): Terminating (SIGTERM) 11:14:45.092691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13012): Terminating (SIGTERM) 11:14:45.135080 --- ParallelTerminationStrategy: PID 13006 died... 11:14:45.155379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13006): Terminated: ok {rc=0} 11:14:45.201458 --- ParallelTerminationStrategy: PID 13009 died... 11:14:45.221218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13009): Terminated: ok {rc=0} 11:14:45.267156 --- ParallelTerminationStrategy: PID 13012 died... 11:14:45.286787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13012): Terminated: ok {rc=0} 11:14:45.374237 bus /sierra_3: Setting Powered False 11:14:46.479296 bus /sierra_3: Setting Powered False 11:14:47.606373 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 11:14:48.692227 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:14:48.703975 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 11:14:48.754883 tst emergency_preemptive_call.py: using LAC 33561 11:14:48.870752 tst emergency_preemptive_call.py: using RAC 156 11:14:48.987991 tst emergency_preemptive_call.py: using CellId 33561 11:14:49.102656 tst emergency_preemptive_call.py: using BVCI 33562 11:14:49.218571 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:14:49.229776 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:14:49.240619 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:14:49.251479 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:14:49.262918 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:14:49.274456 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 11:14:49.392691 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 11:14:49.508427 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 11:14:49.626610 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 11:14:49.741999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:50.196301 run create_hlr_db(pid=13015): Launched 11:14:50.316423 bus /sierra_2: Setting Powered False 11:14:51.375940 run create_hlr_db(pid=13015): Terminated: ok {rc=0} 11:14:51.806583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13018): Launched 11:14:52.120726 run osmo-hlr_10.42.42.2(pid=13019): Launched 11:14:52.241076 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:52.782367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13021): Launched 11:14:53.096576 run osmo-stp_10.42.42.5(pid=13022): Launched 11:14:53.225632 tst emergency_preemptive_call.py: using MSISDN 8122 11:14:53.387140 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:53.952064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13024): Launched 11:14:54.266313 run osmo-msc_10.42.42.6(pid=13025): Launched 11:14:54.441594 run osmo-stp_10.42.42.5(pid=13022): ERR: Terminated: ERROR {rc=1} [trial-2388↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13022)] 11:14:54.573844 run osmo-stp_10.42.42.5(pid=13022): stdout: | (launched: 2022-12-13_11:14:53.038973) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:54.706909 run osmo-stp_10.42.42.5(pid=13022): stderr: | 20221213111453232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111453232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111453233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111453233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111453233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111453233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111453234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:54.839813 run osmo-stp_10.42.42.5(pid=13022): stdout: | (launched: 2022-12-13_11:14:53.038973) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:54.966288 run osmo-stp_10.42.42.5(pid=13022): stderr: | 20221213111453232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111453232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111453233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111453233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111453233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111453233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111453234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:55.116661 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13022): Process ended prematurely: osmo-stp_10.42.42.5(pid=13022) [trial-2388↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13022)] [trial-2388↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 11:14:55.125694 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 11:14:55.153189 run osmo-hlr_10.42.42.2(pid=13019): ERR: Terminated: ERROR {rc=237} [trial-2388↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13019)] 11:14:55.204190 run osmo-hlr_10.42.42.2(pid=13019): stdout: | (launched: 2022-12-13_11:14:52.063227) 11:14:55.256552 run osmo-hlr_10.42.42.2(pid=13019): stderr: | 20221213111452262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111452262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111452262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111452262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111452262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111452262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111452275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111452286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111452286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111452286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:55.330200 run osmo-msc_10.42.42.6(pid=13025): ERR: Terminated: ERROR {rc=2} [trial-2388↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13025)] 11:14:55.380545 run osmo-msc_10.42.42.6(pid=13025): stdout: | (launched: 2022-12-13_11:14:54.208846) 11:14:55.432745 run osmo-msc_10.42.42.6(pid=13025): stderr: | 20221213111454530 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111454530 DLGLOBAL DEBUG validating counter group 0x7ff8f8f80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111454531 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111454531 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111454531 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111454531 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111454533 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111454533 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111454533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111454534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:55.485337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13018): Terminating (SIGTERM) 11:14:55.527703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13021): Terminating (SIGTERM) 11:14:55.570281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13024): Terminating (SIGTERM) 11:14:55.613472 --- ParallelTerminationStrategy: PID 13018 died... 11:14:55.634161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13018): Terminated: ok {rc=0} 11:14:55.680918 --- ParallelTerminationStrategy: PID 13021 died... 11:14:55.701078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13021): Terminated: ok {rc=0} 11:14:55.747538 --- ParallelTerminationStrategy: PID 13024 died... 11:14:55.767608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13024): Terminated: ok {rc=0} 11:14:55.855867 bus /sierra_9: Setting Powered False 11:14:56.955128 bus /sierra_9: Setting Powered False 11:14:58.072561 bus /sierra_8: Setting Powered False 11:14:59.170541 bus /sierra_8: Setting Powered False 11:15:00.283797 bus /sierra_3: Setting Powered False 11:15:01.380600 bus /sierra_3: Setting Powered False 11:15:02.498968 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-900 --------------------------------------------------------------------- 11:15:03.775255 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:15:03.782135 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 11:15:03.815242 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 11:15:03.855665 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 11:15:03.945803 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 11:15:03.978748 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 11:15:04.017913 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 11:15:04.606840 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 11:15:04.659360 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:04.670453 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:15:04.718143 tst cs_paging_gprs_active.py: using LAC 33562 11:15:04.843641 tst cs_paging_gprs_active.py: using RAC 157 11:15:04.962684 tst cs_paging_gprs_active.py: using CellId 33562 11:15:05.082236 tst cs_paging_gprs_active.py: using BVCI 33563 11:15:05.190753 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:05.201576 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:05.212080 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:05.222390 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:05.232644 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:05.242913 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:05.253353 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:05.263540 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:05.273975 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:15:05.390918 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:15:05.510722 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:15:05.711636 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:15:06.011384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13034): Launched 11:15:06.271923 run iperf3-srv_10.42.42.10(pid=13035): Launched 11:15:06.383849 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:15:06.583324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:15:06.882628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13036): Launched 11:15:07.141623 run iperf3-srv_10.42.42.10(pid=13037): Launched 11:15:07.252808 tst cs_paging_gprs_active.py:38: start network... 11:15:07.452825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:15:07.913683 run create_hlr_db(pid=13038): Launched 11:15:08.034255 bus /sierra_2: Setting Powered False 11:15:09.093720 run create_hlr_db(pid=13038): Terminated: ok {rc=0} 11:15:09.531341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13040): Launched 11:15:09.851716 run osmo-hlr_10.42.42.2(pid=13041): Launched 11:15:09.974781 run osmo-stp_10.42.42.5: Starting osmo-stp 11:15:10.504343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13043): Launched 11:15:10.802663 run osmo-stp_10.42.42.5(pid=13044): Launched 11:15:10.916411 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:15:11.429878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13046): Launched 11:15:11.544401 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:15:11.797094 run patchelf(pid=13047): Launched 11:15:11.963145 run osmo-stp_10.42.42.5(pid=13044): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13044)] 11:15:12.089684 run osmo-stp_10.42.42.5(pid=13044): stdout: | (launched: 2022-12-13_11:15:10.747618) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:12.217232 run osmo-stp_10.42.42.5(pid=13044): stderr: | 20221213111510918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111510918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111510918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111510919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111510919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111510919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111510919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:12.344411 run osmo-stp_10.42.42.5(pid=13044): stdout: | (launched: 2022-12-13_11:15:10.747618) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:12.466610 run osmo-stp_10.42.42.5(pid=13044): stderr: | 20221213111510918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111510918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111510918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111510919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111510919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111510919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111510919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:12.611182 run patchelf(pid=13047): Terminating (SIGINT) 11:15:12.779372 run patchelf(pid=13047): Terminated: ok {rc=0} 11:15:12.900665 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13044): Process ended prematurely: osmo-stp_10.42.42.5(pid=13044) [trial-2388↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13044)] [trial-2388↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 11:15:12.910275 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 11:15:12.937249 run osmo-hlr_10.42.42.2(pid=13041): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13041)] 11:15:12.984619 run osmo-hlr_10.42.42.2(pid=13041): stdout: | (launched: 2022-12-13_11:15:09.793452) 11:15:13.033679 run osmo-hlr_10.42.42.2(pid=13041): stderr: | 20221213111509995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111509995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111509995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111509995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111509995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111509995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111510007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111510017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111510017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111510017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:15:13.082959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13034): Terminating (SIGTERM) 11:15:13.122527 run iperf3-srv_10.42.42.10(pid=13035): Terminating (SIGTERM) 11:15:13.161852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13036): Terminating (SIGTERM) 11:15:13.201352 run iperf3-srv_10.42.42.10(pid=13037): Terminating (SIGTERM) 11:15:13.240818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13040): Terminating (SIGTERM) 11:15:13.280288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13043): Terminating (SIGTERM) 11:15:13.319731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13046): Terminating (SIGTERM) 11:15:13.359558 --- ParallelTerminationStrategy: PID 13034 died... 11:15:13.378916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13034): Terminated: ok {rc=0} 11:15:13.422876 --- ParallelTerminationStrategy: PID 13035 died... 11:15:13.441540 run iperf3-srv_10.42.42.10(pid=13035): Terminated {rc=256} 11:15:13.485570 --- ParallelTerminationStrategy: PID 13036 died... 11:15:13.504326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13036): Terminated: ok {rc=0} 11:15:13.547741 --- ParallelTerminationStrategy: PID 13037 died... 11:15:13.566351 run iperf3-srv_10.42.42.10(pid=13037): Terminated {rc=256} 11:15:13.609526 --- ParallelTerminationStrategy: PID 13040 died... 11:15:13.628273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13040): Terminated: ok {rc=0} 11:15:13.671798 --- ParallelTerminationStrategy: PID 13043 died... 11:15:13.690445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13043): Terminated: ok {rc=0} 11:15:13.733865 --- ParallelTerminationStrategy: PID 13046 died... 11:15:13.752573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13046): Terminated: ok {rc=0} 11:15:13.838052 bus /gobi_0: Setting Powered False 11:15:14.936119 bus /gobi_0: Setting Powered False 11:15:16.051384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 11:15:17.202176 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:17.214698 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:15:17.271864 tst iperf3.py: using LAC 33563 11:15:17.396859 tst iperf3.py: using RAC 158 11:15:17.521684 tst iperf3.py: using CellId 33563 11:15:17.649234 tst iperf3.py: using BVCI 33564 11:15:17.758130 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:17.768791 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:17.779417 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:17.789983 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:17.800401 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:17.810975 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:17.821467 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:17.831673 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:17.842123 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:15:17.957022 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:15:18.174836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:15:18.496786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13048): Launched 11:15:18.775546 run iperf3-srv_10.42.42.10(pid=13049): Launched 11:15:18.896074 tst iperf3.py:8: start network... 11:15:19.112695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:15:19.609516 run create_hlr_db(pid=13050): Launched 11:15:19.731841 bus /gobi_6: Setting Powered False 11:15:20.794659 run create_hlr_db(pid=13050): Terminated: ok {rc=0} 11:15:21.223632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13052): Launched 11:15:21.523773 run osmo-hlr_10.42.42.2(pid=13053): Launched 11:15:21.638242 run osmo-stp_10.42.42.5: Starting osmo-stp 11:15:22.168542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13055): Launched 11:15:22.467970 run osmo-stp_10.42.42.5(pid=13056): Launched 11:15:22.582399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:15:23.095211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13058): Launched 11:15:23.208880 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:15:23.460105 run patchelf(pid=13059): Launched 11:15:23.626595 run osmo-stp_10.42.42.5(pid=13056): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13056)] 11:15:23.753107 run osmo-stp_10.42.42.5(pid=13056): stdout: | (launched: 2022-12-13_11:15:22.413081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:23.880779 run osmo-stp_10.42.42.5(pid=13056): stderr: | 20221213111522585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111522585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111522585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111522586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111522586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111522586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111522586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:24.008623 run osmo-stp_10.42.42.5(pid=13056): stdout: | (launched: 2022-12-13_11:15:22.413081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:24.131259 run osmo-stp_10.42.42.5(pid=13056): stderr: | 20221213111522585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111522585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111522585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111522586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111522586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111522586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111522586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:24.275510 run patchelf(pid=13059): Terminating (SIGINT) 11:15:24.443537 run patchelf(pid=13059): Terminated: ok {rc=0} 11:15:24.564721 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13056): Process ended prematurely: osmo-stp_10.42.42.5(pid=13056) [trial-2388↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13056)] [trial-2388↪gprs:nanobts+band-900↪iperf3.py:8] 11:15:24.574138 tst iperf3.py:8: Test FAILED (7.4 sec) 11:15:24.600796 run osmo-hlr_10.42.42.2(pid=13053): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13053)] 11:15:24.648526 run osmo-hlr_10.42.42.2(pid=13053): stdout: | (launched: 2022-12-13_11:15:21.468154) 11:15:24.697228 run osmo-hlr_10.42.42.2(pid=13053): stderr: | 20221213111521644 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111521644 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111521644 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111521644 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111521644 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111521644 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111521656 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111521666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111521666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111521666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:15:24.746567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13048): Terminating (SIGTERM) 11:15:24.786157 run iperf3-srv_10.42.42.10(pid=13049): Terminating (SIGTERM) 11:15:24.825560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13052): Terminating (SIGTERM) 11:15:24.865068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13055): Terminating (SIGTERM) 11:15:24.904368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13058): Terminating (SIGTERM) 11:15:24.944104 --- ParallelTerminationStrategy: PID 13048 died... 11:15:24.962983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13048): Terminated: ok {rc=0} 11:15:25.006990 --- ParallelTerminationStrategy: PID 13049 died... 11:15:25.025930 run iperf3-srv_10.42.42.10(pid=13049): Terminated {rc=256} 11:15:25.069530 --- ParallelTerminationStrategy: PID 13052 died... 11:15:25.088291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13052): Terminated: ok {rc=0} 11:15:25.132094 --- ParallelTerminationStrategy: PID 13055 died... 11:15:25.150927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13055): Terminated: ok {rc=0} 11:15:25.194536 --- ParallelTerminationStrategy: PID 13058 died... 11:15:25.213328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13058): Terminated: ok {rc=0} 11:15:25.296221 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 11:15:26.443909 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:26.455432 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:15:26.503576 tst iperf3m4.py: using LAC 33564 11:15:26.631324 tst iperf3m4.py: using RAC 159 11:15:26.756379 tst iperf3m4.py: using CellId 33564 11:15:26.881036 tst iperf3m4.py: using BVCI 33565 11:15:26.997585 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:27.008638 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:27.019674 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:27.030561 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:27.041844 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:27.053003 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:27.064368 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:27.075553 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:27.086923 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:15:27.206240 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:15:27.324323 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:15:27.447255 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:15:27.566435 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:15:27.784051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:15:28.107906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13060): Launched 11:15:28.385724 run iperf3-srv_10.42.42.10(pid=13061): Launched 11:15:28.505559 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:15:28.721229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:15:29.042983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13062): Launched 11:15:29.321404 run iperf3-srv_10.42.42.10(pid=13063): Launched 11:15:29.441627 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:15:29.658654 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:15:29.981769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13064): Launched 11:15:30.259928 run iperf3-srv_10.42.42.10(pid=13065): Launched 11:15:30.380175 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:15:30.596401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:15:30.925700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13066): Launched 11:15:31.222257 run iperf3-srv_10.42.42.10(pid=13067): Launched 11:15:31.353864 tst iperf3m4.py:8: start network... 11:15:31.574831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:15:32.086967 run create_hlr_db(pid=13068): Launched 11:15:32.243277 bus /gobi_6: Setting Powered False 11:15:33.306933 run create_hlr_db(pid=13068): Terminated: ok {rc=0} 11:15:33.735492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13070): Launched 11:15:34.034710 run osmo-hlr_10.42.42.2(pid=13071): Launched 11:15:34.147479 run osmo-stp_10.42.42.5: Starting osmo-stp 11:15:34.661469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13073): Launched 11:15:34.960108 run osmo-stp_10.42.42.5(pid=13074): Launched 11:15:35.074109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:15:35.588542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13076): Launched 11:15:35.703698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:15:35.955797 run patchelf(pid=13077): Launched 11:15:36.121696 run osmo-stp_10.42.42.5(pid=13074): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13074)] 11:15:36.248200 run osmo-stp_10.42.42.5(pid=13074): stdout: | (launched: 2022-12-13_11:15:34.905212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:36.375888 run osmo-stp_10.42.42.5(pid=13074): stderr: | 20221213111535072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111535072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111535072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111535073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111535073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111535073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111535073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:36.503711 run osmo-stp_10.42.42.5(pid=13074): stdout: | (launched: 2022-12-13_11:15:34.905212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:36.626031 run osmo-stp_10.42.42.5(pid=13074): stderr: | 20221213111535072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111535072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111535072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111535073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111535073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111535073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111535073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:36.771081 run patchelf(pid=13077): Terminating (SIGINT) 11:15:36.939959 run patchelf(pid=13077): Terminated: ok {rc=0} 11:15:37.061187 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13074): Process ended prematurely: osmo-stp_10.42.42.5(pid=13074) [trial-2388↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13074)] [trial-2388↪gprs:nanobts+band-900↪iperf3m4.py:8] 11:15:37.070503 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:15:37.097687 run osmo-hlr_10.42.42.2(pid=13071): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13071)] 11:15:37.144923 run osmo-hlr_10.42.42.2(pid=13071): stdout: | (launched: 2022-12-13_11:15:33.979222) 11:15:37.193779 run osmo-hlr_10.42.42.2(pid=13071): stderr: | 20221213111534155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111534155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111534155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111534155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111534155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111534155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111534168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111534179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111534179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111534179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:15:37.243094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13060): Terminating (SIGTERM) 11:15:37.282488 run iperf3-srv_10.42.42.10(pid=13061): Terminating (SIGTERM) 11:15:37.321841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13062): Terminating (SIGTERM) 11:15:37.361247 run iperf3-srv_10.42.42.10(pid=13063): Terminating (SIGTERM) 11:15:37.400399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13064): Terminating (SIGTERM) 11:15:37.439787 run iperf3-srv_10.42.42.10(pid=13065): Terminating (SIGTERM) 11:15:37.478928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13066): Terminating (SIGTERM) 11:15:37.518142 run iperf3-srv_10.42.42.10(pid=13067): Terminating (SIGTERM) 11:15:37.557209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13070): Terminating (SIGTERM) 11:15:37.596401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13073): Terminating (SIGTERM) 11:15:37.635552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13076): Terminating (SIGTERM) 11:15:37.675628 --- ParallelTerminationStrategy: PID 13060 died... 11:15:37.694787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13060): Terminated: ok {rc=0} 11:15:37.738664 --- ParallelTerminationStrategy: PID 13061 died... 11:15:37.757266 run iperf3-srv_10.42.42.10(pid=13061): Terminated {rc=256} 11:15:37.800781 --- ParallelTerminationStrategy: PID 13062 died... 11:15:37.819569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13062): Terminated: ok {rc=0} 11:15:37.863347 --- ParallelTerminationStrategy: PID 13063 died... 11:15:37.881983 run iperf3-srv_10.42.42.10(pid=13063): Terminated {rc=256} 11:15:37.925414 --- ParallelTerminationStrategy: PID 13064 died... 11:15:37.943887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13064): Terminated: ok {rc=0} 11:15:37.987789 --- ParallelTerminationStrategy: PID 13065 died... 11:15:38.006386 run iperf3-srv_10.42.42.10(pid=13065): Terminated {rc=256} 11:15:38.049814 --- ParallelTerminationStrategy: PID 13066 died... 11:15:38.068340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13066): Terminated: ok {rc=0} 11:15:38.111900 --- ParallelTerminationStrategy: PID 13067 died... 11:15:38.130582 run iperf3-srv_10.42.42.10(pid=13067): Terminated {rc=256} 11:15:38.174012 --- ParallelTerminationStrategy: PID 13070 died... 11:15:38.192637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13070): Terminated: ok {rc=0} 11:15:38.236304 --- ParallelTerminationStrategy: PID 13073 died... 11:15:38.254981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13073): Terminated: ok {rc=0} 11:15:38.298659 --- ParallelTerminationStrategy: PID 13076 died... 11:15:38.317436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13076): Terminated: ok {rc=0} 11:15:38.402687 bus /gobi_4: Setting Powered False 11:15:39.501855 bus /gobi_4: Setting Powered False 11:15:40.616715 bus /gobi_1: Setting Powered False 11:15:41.716581 bus /gobi_1: Setting Powered False 11:15:42.829323 bus /gobi_0: Setting Powered False 11:15:43.928300 bus /gobi_0: Setting Powered False 11:15:45.046990 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900 ping.py ---------------------------------------------- 11:15:46.160900 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:46.176244 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:15:46.230681 tst ping.py: using LAC 33565 11:15:46.353191 tst ping.py: using RAC 160 11:15:46.480801 tst ping.py: using CellId 33565 11:15:46.597389 tst ping.py: using BVCI 33566 11:15:46.731316 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:46.742777 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:46.754042 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:46.765582 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:46.776850 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:46.788358 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:46.799961 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:46.811487 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:15:46.945665 tst ping.py:19: start network... 11:15:47.179692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:15:47.669911 run create_hlr_db(pid=13078): Launched 11:15:47.789609 bus /gobi_6: Setting Powered False 11:15:48.852375 run create_hlr_db(pid=13078): Terminated: ok {rc=0} 11:15:49.271720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13080): Launched 11:15:49.563655 run osmo-hlr_10.42.42.2(pid=13081): Launched 11:15:49.675633 run osmo-stp_10.42.42.5: Starting osmo-stp 11:15:50.193523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13083): Launched 11:15:50.483509 run osmo-stp_10.42.42.5(pid=13084): Launched 11:15:50.595429 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:15:51.100094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13086): Launched 11:15:51.211130 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:15:51.457920 run patchelf(pid=13087): Launched 11:15:51.620397 run osmo-stp_10.42.42.5(pid=13084): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13084)] 11:15:51.744576 run osmo-stp_10.42.42.5(pid=13084): stdout: | (launched: 2022-12-13_11:15:50.429792) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:51.879500 run osmo-stp_10.42.42.5(pid=13084): stderr: | 20221213111550598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111550598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111550598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111550599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111550599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111550599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111550599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:52.016184 run osmo-stp_10.42.42.5(pid=13084): stdout: | (launched: 2022-12-13_11:15:50.429792) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:52.145601 run osmo-stp_10.42.42.5(pid=13084): stderr: | 20221213111550598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111550598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111550598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111550599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111550599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111550599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111550599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:52.298892 run patchelf(pid=13087): Terminating (SIGINT) 11:15:52.476309 run patchelf(pid=13087): Terminated: ok {rc=0} 11:15:52.604785 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13084): Process ended prematurely: osmo-stp_10.42.42.5(pid=13084) [trial-2388↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13084)] [trial-2388↪gprs:nanobts+band-900↪ping.py:22] 11:15:52.614314 tst ping.py:22: Test FAILED (6.4 sec) 11:15:52.642264 run osmo-hlr_10.42.42.2(pid=13081): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13081)] 11:15:52.692877 run osmo-hlr_10.42.42.2(pid=13081): stdout: | (launched: 2022-12-13_11:15:49.509633) 11:15:52.744883 run osmo-hlr_10.42.42.2(pid=13081): stderr: | 20221213111549686 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111549686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111549686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111549687 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111549687 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111549687 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111549699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111549708 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111549709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111549709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:15:52.797514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13080): Terminating (SIGTERM) 11:15:52.839331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13083): Terminating (SIGTERM) 11:15:52.881544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13086): Terminating (SIGTERM) 11:15:52.924231 --- ParallelTerminationStrategy: PID 13080 died... 11:15:52.944423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13080): Terminated: ok {rc=0} 11:15:52.991221 --- ParallelTerminationStrategy: PID 13083 died... 11:15:53.011364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13083): Terminated: ok {rc=0} 11:15:53.057504 --- ParallelTerminationStrategy: PID 13086 died... 11:15:53.077377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13086): Terminated: ok {rc=0} 11:15:53.165684 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 11:15:54.252417 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:54.264013 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:15:54.313622 tst ping_idle_ping.py: using LAC 33566 11:15:54.431120 tst ping_idle_ping.py: using RAC 161 11:15:54.548125 tst ping_idle_ping.py: using CellId 33566 11:15:54.663681 tst ping_idle_ping.py: using BVCI 33567 11:15:54.771653 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:54.782226 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:54.792676 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:54.803071 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:54.813459 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:54.823714 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:54.834200 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:15:54.844607 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:15:54.963795 tst ping_idle_ping.py:24: start network... 11:15:55.176527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:15:55.667550 run create_hlr_db(pid=13089): Launched 11:15:55.787739 bus /gobi_6: Setting Powered False 11:15:56.850014 run create_hlr_db(pid=13089): Terminated: ok {rc=0} 11:15:57.271951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13091): Launched 11:15:57.565709 run osmo-hlr_10.42.42.2(pid=13092): Launched 11:15:57.677800 run osmo-stp_10.42.42.5: Starting osmo-stp 11:15:58.182863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13094): Launched 11:15:58.475159 run osmo-stp_10.42.42.5(pid=13095): Launched 11:15:58.586637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:15:59.091504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13097): Launched 11:15:59.202676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:15:59.449689 run patchelf(pid=13098): Launched 11:15:59.612303 run osmo-stp_10.42.42.5(pid=13095): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13095)] 11:15:59.735657 run osmo-stp_10.42.42.5(pid=13095): stdout: | (launched: 2022-12-13_11:15:58.421238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:59.861573 run osmo-stp_10.42.42.5(pid=13095): stderr: | 20221213111558589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111558589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111558589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111558590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111558592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111558592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111558592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:59.987150 run osmo-stp_10.42.42.5(pid=13095): stdout: | (launched: 2022-12-13_11:15:58.421238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:00.106745 run osmo-stp_10.42.42.5(pid=13095): stderr: | 20221213111558589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111558589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111558589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111558590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111558592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111558592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111558592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:00.248317 run patchelf(pid=13098): Terminating (SIGINT) 11:16:00.413515 run patchelf(pid=13098): Terminated: ok {rc=0} 11:16:00.532484 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13095): Process ended prematurely: osmo-stp_10.42.42.5(pid=13095) [trial-2388↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13095)] [trial-2388↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 11:16:00.541246 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 11:16:00.567695 run osmo-hlr_10.42.42.2(pid=13092): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13092)] 11:16:00.615392 run osmo-hlr_10.42.42.2(pid=13092): stdout: | (launched: 2022-12-13_11:15:57.511713) 11:16:00.664578 run osmo-hlr_10.42.42.2(pid=13092): stderr: | 20221213111557685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111557685 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111557685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111557685 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111557685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111557685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111557697 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111557707 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111557708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111557708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:16:00.713795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13091): Terminating (SIGTERM) 11:16:00.752996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13094): Terminating (SIGTERM) 11:16:00.792119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13097): Terminating (SIGTERM) 11:16:00.831696 --- ParallelTerminationStrategy: PID 13091 died... 11:16:00.850739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13091): Terminated: ok {rc=0} 11:16:00.917776 --- ParallelTerminationStrategy: PID 13094 died... 11:16:00.953519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13094): Terminated: ok {rc=0} 11:16:00.998576 --- ParallelTerminationStrategy: PID 13097 died... 11:16:01.018526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13097): Terminated: ok {rc=0} 11:16:01.118969 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 11:16:02.436794 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:16:02.444492 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:16:02.476264 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:16:02.513894 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:16:02.601881 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:16:02.633244 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:16:02.670706 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:16:03.272032 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:16:03.327070 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:03.338308 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:16:03.386618 tst cs_paging_gprs_active.py: using LAC 33567 11:16:03.511687 tst cs_paging_gprs_active.py: using RAC 162 11:16:03.635332 tst cs_paging_gprs_active.py: using CellId 33567 11:16:03.760168 tst cs_paging_gprs_active.py: using BVCI 33568 11:16:03.877240 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:03.888464 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:03.899594 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:03.910754 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:03.922192 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:03.933574 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:03.944889 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:03.956297 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:03.968379 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:16:04.085918 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:16:04.206718 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:16:04.424224 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:16:04.747410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13102): Launched 11:16:05.027305 run iperf3-srv_10.42.42.10(pid=13103): Launched 11:16:05.147978 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:16:05.364811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:16:05.687287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13104): Launched 11:16:05.966339 run iperf3-srv_10.42.42.10(pid=13105): Launched 11:16:06.086500 tst cs_paging_gprs_active.py:38: start network... 11:16:06.302766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:16:06.800011 run create_hlr_db(pid=13106): Launched 11:16:06.921559 bus /gobi_6: Setting Powered False 11:16:07.985325 run create_hlr_db(pid=13106): Terminated: ok {rc=0} 11:16:08.413376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13108): Launched 11:16:08.711803 run osmo-hlr_10.42.42.2(pid=13109): Launched 11:16:08.826388 run osmo-stp_10.42.42.5: Starting osmo-stp 11:16:09.357430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13111): Launched 11:16:09.654677 run osmo-stp_10.42.42.5(pid=13112): Launched 11:16:09.768502 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:16:10.284637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13114): Launched 11:16:10.398987 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:16:10.651612 run patchelf(pid=13115): Launched 11:16:10.817739 run osmo-stp_10.42.42.5(pid=13112): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13112)] 11:16:10.944298 run osmo-stp_10.42.42.5(pid=13112): stdout: | (launched: 2022-12-13_11:16:09.599840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:11.072260 run osmo-stp_10.42.42.5(pid=13112): stderr: | 20221213111609770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111609770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111609771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111609771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111609772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111609772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111609772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:11.200286 run osmo-stp_10.42.42.5(pid=13112): stdout: | (launched: 2022-12-13_11:16:09.599840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:11.322864 run osmo-stp_10.42.42.5(pid=13112): stderr: | 20221213111609770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111609770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111609771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111609771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111609772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111609772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111609772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:11.467709 run patchelf(pid=13115): Terminating (SIGINT) 11:16:11.635889 run patchelf(pid=13115): Terminated: ok {rc=0} 11:16:11.756784 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13112): Process ended prematurely: osmo-stp_10.42.42.5(pid=13112) [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13112)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:16:11.766205 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 11:16:11.792894 run osmo-hlr_10.42.42.2(pid=13109): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13109)] 11:16:11.840662 run osmo-hlr_10.42.42.2(pid=13109): stdout: | (launched: 2022-12-13_11:16:08.657078) 11:16:11.889945 run osmo-hlr_10.42.42.2(pid=13109): stderr: | 20221213111608833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111608833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111608833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111608833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111608833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111608833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111608846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111608856 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111608856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111608856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:16:11.939750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13102): Terminating (SIGTERM) 11:16:11.979117 run iperf3-srv_10.42.42.10(pid=13103): Terminating (SIGTERM) 11:16:12.018403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13104): Terminating (SIGTERM) 11:16:12.057633 run iperf3-srv_10.42.42.10(pid=13105): Terminating (SIGTERM) 11:16:12.096883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13108): Terminating (SIGTERM) 11:16:12.136254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13111): Terminating (SIGTERM) 11:16:12.175408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13114): Terminating (SIGTERM) 11:16:12.215010 --- ParallelTerminationStrategy: PID 13102 died... 11:16:12.234048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13102): Terminated: ok {rc=0} 11:16:12.277792 --- ParallelTerminationStrategy: PID 13103 died... 11:16:12.296254 run iperf3-srv_10.42.42.10(pid=13103): Terminated {rc=256} 11:16:12.339721 --- ParallelTerminationStrategy: PID 13104 died... 11:16:12.358313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13104): Terminated: ok {rc=0} 11:16:12.401753 --- ParallelTerminationStrategy: PID 13105 died... 11:16:12.420146 run iperf3-srv_10.42.42.10(pid=13105): Terminated {rc=256} 11:16:12.463499 --- ParallelTerminationStrategy: PID 13108 died... 11:16:12.482063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13108): Terminated: ok {rc=0} 11:16:12.525614 --- ParallelTerminationStrategy: PID 13111 died... 11:16:12.544151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13111): Terminated: ok {rc=0} 11:16:12.587653 --- ParallelTerminationStrategy: PID 13114 died... 11:16:12.606360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13114): Terminated: ok {rc=0} 11:16:12.691475 bus /gobi_0: Setting Powered False 11:16:13.791502 bus /gobi_0: Setting Powered False 11:16:14.907598 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:16:16.066868 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:16.080301 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:16:16.136104 tst iperf3.py: using LAC 33568 11:16:16.257071 tst iperf3.py: using RAC 163 11:16:16.423828 tst iperf3.py: using CellId 33568 11:16:16.557262 tst iperf3.py: using BVCI 33569 11:16:16.673736 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:16.685251 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:16.696267 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:16.707570 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:16.718754 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:16.730182 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:16.741688 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:16.752754 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:16.764149 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:16:16.877571 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:16:17.081677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:16:17.386369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13116): Launched 11:16:17.646500 run iperf3-srv_10.42.42.10(pid=13117): Launched 11:16:17.758091 tst iperf3.py:8: start network... 11:16:17.957485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:16:18.420103 run create_hlr_db(pid=13118): Launched 11:16:18.542343 bus /gobi_6: Setting Powered False 11:16:19.602689 run create_hlr_db(pid=13118): Terminated: ok {rc=0} 11:16:20.039519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13120): Launched 11:16:20.360564 run osmo-hlr_10.42.42.2(pid=13121): Launched 11:16:20.483688 run osmo-stp_10.42.42.5: Starting osmo-stp 11:16:21.036342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13123): Launched 11:16:21.357579 run osmo-stp_10.42.42.5(pid=13124): Launched 11:16:21.479303 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:16:22.034297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13126): Launched 11:16:22.157188 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:16:22.428361 run patchelf(pid=13127): Launched 11:16:22.606681 run osmo-stp_10.42.42.5(pid=13124): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13124)] 11:16:22.743034 run osmo-stp_10.42.42.5(pid=13124): stdout: | (launched: 2022-12-13_11:16:21.298807) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:22.880381 run osmo-stp_10.42.42.5(pid=13124): stderr: | 20221213111621491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111621491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111621491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111621492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111621494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111621494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111621494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:23.018832 run osmo-stp_10.42.42.5(pid=13124): stdout: | (launched: 2022-12-13_11:16:21.298807) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:23.150844 run osmo-stp_10.42.42.5(pid=13124): stderr: | 20221213111621491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111621491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111621491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111621492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111621494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111621494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111621494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:23.307376 run patchelf(pid=13127): Terminating (SIGINT) 11:16:23.488521 run patchelf(pid=13127): Terminated: ok {rc=0} 11:16:23.619587 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13124): Process ended prematurely: osmo-stp_10.42.42.5(pid=13124) [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13124)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 11:16:23.629730 tst iperf3.py:8: Test FAILED (7.6 sec) 11:16:23.658156 run osmo-hlr_10.42.42.2(pid=13121): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13121)] 11:16:23.708348 run osmo-hlr_10.42.42.2(pid=13121): stdout: | (launched: 2022-12-13_11:16:20.302202) 11:16:23.759824 run osmo-hlr_10.42.42.2(pid=13121): stderr: | 20221213111620502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111620503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111620503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111620503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111620503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111620503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111620515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111620523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111620524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111620524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:16:23.811579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13116): Terminating (SIGTERM) 11:16:23.853497 run iperf3-srv_10.42.42.10(pid=13117): Terminating (SIGTERM) 11:16:23.895254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13120): Terminating (SIGTERM) 11:16:23.937125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13123): Terminating (SIGTERM) 11:16:23.979134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13126): Terminating (SIGTERM) 11:16:24.021822 --- ParallelTerminationStrategy: PID 13116 died... 11:16:24.042376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13116): Terminated: ok {rc=0} 11:16:24.089267 --- ParallelTerminationStrategy: PID 13117 died... 11:16:24.109118 run iperf3-srv_10.42.42.10(pid=13117): Terminated {rc=256} 11:16:24.155373 --- ParallelTerminationStrategy: PID 13120 died... 11:16:24.175332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13120): Terminated: ok {rc=0} 11:16:24.221778 --- ParallelTerminationStrategy: PID 13123 died... 11:16:24.241699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13123): Terminated: ok {rc=0} 11:16:24.288171 --- ParallelTerminationStrategy: PID 13126 died... 11:16:24.308155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13126): Terminated: ok {rc=0} 11:16:24.396484 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:16:25.545661 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:25.557508 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:16:25.607262 tst iperf3m4.py: using LAC 33569 11:16:25.734157 tst iperf3m4.py: using RAC 164 11:16:25.859342 tst iperf3m4.py: using CellId 33569 11:16:25.978519 tst iperf3m4.py: using BVCI 33570 11:16:26.089168 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:26.099969 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:26.110584 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:26.121242 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:26.131717 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:26.142212 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:26.152901 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:26.163369 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:26.174015 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:16:26.294375 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:16:26.413382 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:16:26.531678 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:16:26.651466 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:16:26.867820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:16:27.190600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13128): Launched 11:16:27.470121 run iperf3-srv_10.42.42.10(pid=13129): Launched 11:16:27.591921 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:16:27.808507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:16:28.131844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13130): Launched 11:16:28.410714 run iperf3-srv_10.42.42.10(pid=13131): Launched 11:16:28.530639 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:16:28.746458 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:16:29.068744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13132): Launched 11:16:29.347907 run iperf3-srv_10.42.42.10(pid=13133): Launched 11:16:29.468271 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:16:29.684531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:16:30.006652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13134): Launched 11:16:30.285743 run iperf3-srv_10.42.42.10(pid=13135): Launched 11:16:30.406146 tst iperf3m4.py:8: start network... 11:16:30.622271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:16:31.162512 run create_hlr_db(pid=13136): Launched 11:16:31.321965 bus /gobi_6: Setting Powered False 11:16:32.385873 run create_hlr_db(pid=13136): Terminated: ok {rc=0} 11:16:32.813842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13138): Launched 11:16:33.113408 run osmo-hlr_10.42.42.2(pid=13139): Launched 11:16:33.229548 run osmo-stp_10.42.42.5: Starting osmo-stp 11:16:33.742498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13141): Launched 11:16:34.041380 run osmo-stp_10.42.42.5(pid=13142): Launched 11:16:34.155362 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:16:34.668233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13144): Launched 11:16:34.782293 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:16:35.034162 run patchelf(pid=13145): Launched 11:16:35.199449 run osmo-stp_10.42.42.5(pid=13142): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13142)] 11:16:35.325233 run osmo-stp_10.42.42.5(pid=13142): stdout: | (launched: 2022-12-13_11:16:33.985975) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:35.452271 run osmo-stp_10.42.42.5(pid=13142): stderr: | 20221213111634155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111634155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111634156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111634156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111634157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111634157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111634157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:35.579499 run osmo-stp_10.42.42.5(pid=13142): stdout: | (launched: 2022-12-13_11:16:33.985975) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:35.701274 run osmo-stp_10.42.42.5(pid=13142): stderr: | 20221213111634155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111634155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111634156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111634156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111634157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111634157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111634157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:35.845421 run patchelf(pid=13145): Terminating (SIGINT) 11:16:36.013287 run patchelf(pid=13145): Terminated: ok {rc=0} 11:16:36.135003 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13142): Process ended prematurely: osmo-stp_10.42.42.5(pid=13142) [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13142)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 11:16:36.144437 tst iperf3m4.py:8: Test FAILED (10.6 sec) 11:16:36.171811 run osmo-hlr_10.42.42.2(pid=13139): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13139)] 11:16:36.218906 run osmo-hlr_10.42.42.2(pid=13139): stdout: | (launched: 2022-12-13_11:16:33.058146) 11:16:36.267908 run osmo-hlr_10.42.42.2(pid=13139): stderr: | 20221213111633233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111633233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111633233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111633233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111633233 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111633233 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111633244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111633253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111633254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111633254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:16:36.317235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13128): Terminating (SIGTERM) 11:16:36.356148 run iperf3-srv_10.42.42.10(pid=13129): Terminating (SIGTERM) 11:16:36.395344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13130): Terminating (SIGTERM) 11:16:36.434508 run iperf3-srv_10.42.42.10(pid=13131): Terminating (SIGTERM) 11:16:36.473443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13132): Terminating (SIGTERM) 11:16:36.512770 run iperf3-srv_10.42.42.10(pid=13133): Terminating (SIGTERM) 11:16:36.551860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13134): Terminating (SIGTERM) 11:16:36.591083 run iperf3-srv_10.42.42.10(pid=13135): Terminating (SIGTERM) 11:16:36.630174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13138): Terminating (SIGTERM) 11:16:36.669293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13141): Terminating (SIGTERM) 11:16:36.708363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13144): Terminating (SIGTERM) 11:16:36.747956 --- ParallelTerminationStrategy: PID 13128 died... 11:16:36.766976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13128): Terminated: ok {rc=0} 11:16:36.810710 --- ParallelTerminationStrategy: PID 13129 died... 11:16:36.829151 run iperf3-srv_10.42.42.10(pid=13129): Terminated {rc=256} 11:16:36.872374 --- ParallelTerminationStrategy: PID 13130 died... 11:16:36.890828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13130): Terminated: ok {rc=0} 11:16:36.934082 --- ParallelTerminationStrategy: PID 13131 died... 11:16:36.952292 run iperf3-srv_10.42.42.10(pid=13131): Terminated {rc=256} 11:16:36.995604 --- ParallelTerminationStrategy: PID 13132 died... 11:16:37.014016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13132): Terminated: ok {rc=0} 11:16:37.057286 --- ParallelTerminationStrategy: PID 13133 died... 11:16:37.075458 run iperf3-srv_10.42.42.10(pid=13133): Terminated {rc=256} 11:16:37.118806 --- ParallelTerminationStrategy: PID 13134 died... 11:16:37.137253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13134): Terminated: ok {rc=0} 11:16:37.180374 --- ParallelTerminationStrategy: PID 13135 died... 11:16:37.198759 run iperf3-srv_10.42.42.10(pid=13135): Terminated {rc=256} 11:16:37.241726 --- ParallelTerminationStrategy: PID 13138 died... 11:16:37.260152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13138): Terminated: ok {rc=0} 11:16:37.303313 --- ParallelTerminationStrategy: PID 13141 died... 11:16:37.321810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13141): Terminated: ok {rc=0} 11:16:37.365061 --- ParallelTerminationStrategy: PID 13144 died... 11:16:37.383504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13144): Terminated: ok {rc=0} 11:16:37.467936 bus /gobi_4: Setting Powered False 11:16:38.568614 bus /gobi_4: Setting Powered False 11:16:39.682264 bus /gobi_1: Setting Powered False 11:16:40.779431 bus /gobi_1: Setting Powered False 11:16:41.893720 bus /gobi_0: Setting Powered False 11:16:42.992761 bus /gobi_0: Setting Powered False 11:16:44.110570 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 11:16:45.212199 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:45.223559 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:16:45.272522 tst ping.py: using LAC 33570 11:16:45.389184 tst ping.py: using RAC 165 11:16:45.504209 tst ping.py: using CellId 33570 11:16:45.618971 tst ping.py: using BVCI 33571 11:16:45.726096 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:45.737027 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:45.747654 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:45.758257 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:45.768707 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:45.779287 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:45.790109 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:45.800614 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:16:45.916929 tst ping.py:19: start network... 11:16:46.137530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:16:46.639331 run create_hlr_db(pid=13146): Launched 11:16:46.799528 bus /gobi_6: Setting Powered False 11:16:47.862899 run create_hlr_db(pid=13146): Terminated: ok {rc=0} 11:16:48.287738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13148): Launched 11:16:48.581475 run osmo-hlr_10.42.42.2(pid=13149): Launched 11:16:48.693400 run osmo-stp_10.42.42.5: Starting osmo-stp 11:16:49.215935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13151): Launched 11:16:49.509438 run osmo-stp_10.42.42.5(pid=13152): Launched 11:16:49.620703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:16:50.145548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13154): Launched 11:16:50.258351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:16:50.506175 run patchelf(pid=13155): Launched 11:16:50.668770 run osmo-stp_10.42.42.5(pid=13152): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13152)] 11:16:50.793225 run osmo-stp_10.42.42.5(pid=13152): stdout: | (launched: 2022-12-13_11:16:49.455329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:50.918686 run osmo-stp_10.42.42.5(pid=13152): stderr: | 20221213111649625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111649625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111649626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111649626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111649626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111649627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111649627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:51.044477 run osmo-stp_10.42.42.5(pid=13152): stdout: | (launched: 2022-12-13_11:16:49.455329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:51.164100 run osmo-stp_10.42.42.5(pid=13152): stderr: | 20221213111649625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111649625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111649626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111649626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111649626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111649627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111649627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:51.306408 run patchelf(pid=13155): Terminating (SIGINT) 11:16:51.471098 run patchelf(pid=13155): Terminated: ok {rc=0} 11:16:51.589865 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13152): Process ended prematurely: osmo-stp_10.42.42.5(pid=13152) [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13152)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 11:16:51.598526 tst ping.py:22: Test FAILED (6.4 sec) 11:16:51.624887 run osmo-hlr_10.42.42.2(pid=13149): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13149)] 11:16:51.672125 run osmo-hlr_10.42.42.2(pid=13149): stdout: | (launched: 2022-12-13_11:16:48.527044) 11:16:51.720605 run osmo-hlr_10.42.42.2(pid=13149): stderr: | 20221213111648704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111648704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111648704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111648705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111648705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111648705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111648717 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111648725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111648725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111648725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:16:51.769632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13148): Terminating (SIGTERM) 11:16:51.809074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13151): Terminating (SIGTERM) 11:16:51.848291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13154): Terminating (SIGTERM) 11:16:51.888261 --- ParallelTerminationStrategy: PID 13148 died... 11:16:51.907443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13148): Terminated: ok {rc=0} 11:16:51.951227 --- ParallelTerminationStrategy: PID 13151 died... 11:16:51.970001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13151): Terminated: ok {rc=0} 11:16:52.013675 --- ParallelTerminationStrategy: PID 13154 died... 11:16:52.032370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13154): Terminated: ok {rc=0} 11:16:52.118095 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:16:53.205848 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:53.217238 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:16:53.266873 tst ping_idle_ping.py: using LAC 33571 11:16:53.391645 tst ping_idle_ping.py: using RAC 166 11:16:53.508612 tst ping_idle_ping.py: using CellId 33571 11:16:53.625192 tst ping_idle_ping.py: using BVCI 33572 11:16:53.732526 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:53.743655 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:53.754479 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:53.765387 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:53.776463 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:53.787758 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:53.799233 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:16:53.810453 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:16:53.924147 tst ping_idle_ping.py:24: start network... 11:16:54.120283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:16:54.578495 run create_hlr_db(pid=13156): Launched 11:16:54.698603 bus /gobi_6: Setting Powered False 11:16:55.758856 run create_hlr_db(pid=13156): Terminated: ok {rc=0} 11:16:56.192341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13158): Launched 11:16:56.509574 run osmo-hlr_10.42.42.2(pid=13159): Launched 11:16:56.630822 run osmo-stp_10.42.42.5: Starting osmo-stp 11:16:57.177614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13161): Launched 11:16:57.492734 run osmo-stp_10.42.42.5(pid=13162): Launched 11:16:57.614534 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:16:58.162054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13164): Launched 11:16:58.282979 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:16:58.551116 run patchelf(pid=13165): Launched 11:16:58.727797 run osmo-stp_10.42.42.5(pid=13162): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13162)] 11:16:58.861915 run osmo-stp_10.42.42.5(pid=13162): stdout: | (launched: 2022-12-13_11:16:57.435089) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:58.998046 run osmo-stp_10.42.42.5(pid=13162): stderr: | 20221213111657625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111657625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111657625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111657625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111657628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111657628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111657628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:59.133763 run osmo-stp_10.42.42.5(pid=13162): stdout: | (launched: 2022-12-13_11:16:57.435089) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:59.263731 run osmo-stp_10.42.42.5(pid=13162): stderr: | 20221213111657625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111657625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111657625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111657625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111657628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111657628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111657628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:59.417671 run patchelf(pid=13165): Terminating (SIGINT) 11:16:59.595916 run patchelf(pid=13165): Terminated: ok {rc=0} 11:16:59.724106 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13162): Process ended prematurely: osmo-stp_10.42.42.5(pid=13162) [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13162)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 11:16:59.733598 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:16:59.761802 run osmo-hlr_10.42.42.2(pid=13159): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13159)] 11:16:59.812458 run osmo-hlr_10.42.42.2(pid=13159): stdout: | (launched: 2022-12-13_11:16:56.451230) 11:16:59.864486 run osmo-hlr_10.42.42.2(pid=13159): stderr: | 20221213111656646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111656646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111656646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111656646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111656646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111656646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111656658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111656667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111656667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111656667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:16:59.916676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13158): Terminating (SIGTERM) 11:16:59.958656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13161): Terminating (SIGTERM) 11:17:00.000875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13164): Terminating (SIGTERM) 11:17:00.043769 --- ParallelTerminationStrategy: PID 13158 died... 11:17:00.064433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13158): Terminated: ok {rc=0} 11:17:00.110869 --- ParallelTerminationStrategy: PID 13161 died... 11:17:00.130873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13161): Terminated: ok {rc=0} 11:17:00.176941 --- ParallelTerminationStrategy: PID 13164 died... 11:17:00.196749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13164): Terminated: ok {rc=0} 11:17:00.285088 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:17:01.588056 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:17:01.599011 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:17:01.637902 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:17:01.685909 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:17:01.789414 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:17:01.842147 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:17:01.895830 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:17:02.458788 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:17:02.511741 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:02.523229 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:17:02.590329 tst cs_paging_gprs_active.py: using LAC 33572 11:17:02.717364 tst cs_paging_gprs_active.py: using RAC 167 11:17:02.843273 tst cs_paging_gprs_active.py: using CellId 33572 11:17:02.967972 tst cs_paging_gprs_active.py: using BVCI 33573 11:17:03.084692 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:03.096017 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:03.107102 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:03.118271 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:03.129686 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:03.141108 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:03.152528 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:03.163863 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:03.175440 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:17:03.291987 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:17:03.413187 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:17:03.613685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:17:03.914156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13172): Launched 11:17:04.176295 run iperf3-srv_10.42.42.10(pid=13173): Launched 11:17:04.287725 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:17:04.488063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:17:04.787503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13174): Launched 11:17:05.047633 run iperf3-srv_10.42.42.10(pid=13175): Launched 11:17:05.159056 tst cs_paging_gprs_active.py:38: start network... 11:17:05.358264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:17:05.821027 run create_hlr_db(pid=13176): Launched 11:17:05.944145 bus /gobi_6: Setting Powered False 11:17:07.004653 run create_hlr_db(pid=13176): Terminated: ok {rc=0} 11:17:07.422097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13178): Launched 11:17:07.721218 run osmo-hlr_10.42.42.2(pid=13179): Launched 11:17:07.834874 run osmo-stp_10.42.42.5: Starting osmo-stp 11:17:08.348308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13181): Launched 11:17:08.647967 run osmo-stp_10.42.42.5(pid=13182): Launched 11:17:08.762206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:17:09.278700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13184): Launched 11:17:09.392407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:17:09.646253 run patchelf(pid=13185): Launched 11:17:09.813125 run osmo-stp_10.42.42.5(pid=13182): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13182)] 11:17:09.939896 run osmo-stp_10.42.42.5(pid=13182): stdout: | (launched: 2022-12-13_11:17:08.592880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:10.068167 run osmo-stp_10.42.42.5(pid=13182): stderr: | 20221213111708763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111708763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111708764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111708764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111708765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111708765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111708765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:10.196151 run osmo-stp_10.42.42.5(pid=13182): stdout: | (launched: 2022-12-13_11:17:08.592880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:10.318641 run osmo-stp_10.42.42.5(pid=13182): stderr: | 20221213111708763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111708763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111708764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111708764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111708765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111708765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111708765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:10.464349 run patchelf(pid=13185): Terminating (SIGINT) 11:17:10.632732 run patchelf(pid=13185): Terminated: ok {rc=0} 11:17:10.754416 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13182): Process ended prematurely: osmo-stp_10.42.42.5(pid=13182) [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13182)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:17:10.763658 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 11:17:10.790690 run osmo-hlr_10.42.42.2(pid=13179): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13179)] 11:17:10.838142 run osmo-hlr_10.42.42.2(pid=13179): stdout: | (launched: 2022-12-13_11:17:07.666014) 11:17:10.887220 run osmo-hlr_10.42.42.2(pid=13179): stderr: | 20221213111707843 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111707843 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111707843 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111707843 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111707843 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111707844 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111707855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111707865 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111707865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111707865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:17:10.937486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13172): Terminating (SIGTERM) 11:17:10.977152 run iperf3-srv_10.42.42.10(pid=13173): Terminating (SIGTERM) 11:17:11.016612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13174): Terminating (SIGTERM) 11:17:11.056202 run iperf3-srv_10.42.42.10(pid=13175): Terminating (SIGTERM) 11:17:11.095791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13178): Terminating (SIGTERM) 11:17:11.135295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13181): Terminating (SIGTERM) 11:17:11.174804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13184): Terminating (SIGTERM) 11:17:11.214657 --- ParallelTerminationStrategy: PID 13172 died... 11:17:11.233851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13172): Terminated: ok {rc=0} 11:17:11.277625 --- ParallelTerminationStrategy: PID 13173 died... 11:17:11.296085 run iperf3-srv_10.42.42.10(pid=13173): Terminated {rc=256} 11:17:11.340212 --- ParallelTerminationStrategy: PID 13174 died... 11:17:11.358977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13174): Terminated: ok {rc=0} 11:17:11.402570 --- ParallelTerminationStrategy: PID 13175 died... 11:17:11.421069 run iperf3-srv_10.42.42.10(pid=13175): Terminated {rc=256} 11:17:11.464763 --- ParallelTerminationStrategy: PID 13178 died... 11:17:11.483506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13178): Terminated: ok {rc=0} 11:17:11.527211 --- ParallelTerminationStrategy: PID 13181 died... 11:17:11.546023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13181): Terminated: ok {rc=0} 11:17:11.589770 --- ParallelTerminationStrategy: PID 13184 died... 11:17:11.608463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13184): Terminated: ok {rc=0} 11:17:11.692528 bus /gobi_0: Setting Powered False 11:17:12.787957 bus /gobi_0: Setting Powered False 11:17:13.899777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:17:15.041838 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:15.053342 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:17:15.121353 tst iperf3.py: using LAC 33573 11:17:15.239186 tst iperf3.py: using RAC 168 11:17:15.356778 tst iperf3.py: using CellId 33573 11:17:15.473968 tst iperf3.py: using BVCI 33574 11:17:15.582946 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:15.594066 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:15.605000 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:15.615846 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:15.626932 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:15.638044 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:15.648866 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:15.659648 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:15.670719 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:17:15.785108 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:17:16.014107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:17:16.374470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13186): Launched 11:17:16.661902 run iperf3-srv_10.42.42.10(pid=13187): Launched 11:17:16.782639 tst iperf3.py:8: start network... 11:17:16.988629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:17:17.459011 run create_hlr_db(pid=13188): Launched 11:17:17.580942 bus /gobi_6: Setting Powered False 11:17:18.640677 run create_hlr_db(pid=13188): Terminated: ok {rc=0} 11:17:19.079201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13190): Launched 11:17:19.401193 run osmo-hlr_10.42.42.2(pid=13191): Launched 11:17:19.524030 run osmo-stp_10.42.42.5: Starting osmo-stp 11:17:20.075346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13193): Launched 11:17:20.395875 run osmo-stp_10.42.42.5(pid=13194): Launched 11:17:20.518920 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:17:21.073797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13196): Launched 11:17:21.196126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:17:21.468400 run patchelf(pid=13197): Launched 11:17:21.646483 run osmo-stp_10.42.42.5(pid=13194): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13194)] 11:17:21.782262 run osmo-stp_10.42.42.5(pid=13194): stdout: | (launched: 2022-12-13_11:17:20.337497) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:21.919448 run osmo-stp_10.42.42.5(pid=13194): stderr: | 20221213111720529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111720529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111720530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111720530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111720530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111720530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111720531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:22.057164 run osmo-stp_10.42.42.5(pid=13194): stdout: | (launched: 2022-12-13_11:17:20.337497) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:22.188739 run osmo-stp_10.42.42.5(pid=13194): stderr: | 20221213111720529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111720529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111720530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111720530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111720530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111720530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111720531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:22.344689 run patchelf(pid=13197): Terminating (SIGINT) 11:17:22.525264 run patchelf(pid=13197): Terminated: ok {rc=0} 11:17:22.655445 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13194): Process ended prematurely: osmo-stp_10.42.42.5(pid=13194) [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13194)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 11:17:22.665617 tst iperf3.py:8: Test FAILED (7.7 sec) 11:17:22.693834 run osmo-hlr_10.42.42.2(pid=13191): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13191)] 11:17:22.744159 run osmo-hlr_10.42.42.2(pid=13191): stdout: | (launched: 2022-12-13_11:17:19.342687) 11:17:22.795966 run osmo-hlr_10.42.42.2(pid=13191): stderr: | 20221213111719542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111719542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111719542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111719542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111719542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111719542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111719554 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111719562 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111719562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111719562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:17:22.848067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13186): Terminating (SIGTERM) 11:17:22.889854 run iperf3-srv_10.42.42.10(pid=13187): Terminating (SIGTERM) 11:17:22.931584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13190): Terminating (SIGTERM) 11:17:22.973414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13193): Terminating (SIGTERM) 11:17:23.015562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13196): Terminating (SIGTERM) 11:17:23.057603 --- ParallelTerminationStrategy: PID 13186 died... 11:17:23.078057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13186): Terminated: ok {rc=0} 11:17:23.124483 --- ParallelTerminationStrategy: PID 13187 died... 11:17:23.144225 run iperf3-srv_10.42.42.10(pid=13187): Terminated {rc=256} 11:17:23.190648 --- ParallelTerminationStrategy: PID 13190 died... 11:17:23.210776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13190): Terminated: ok {rc=0} 11:17:23.256811 --- ParallelTerminationStrategy: PID 13193 died... 11:17:23.277443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13193): Terminated: ok {rc=0} 11:17:23.327761 --- ParallelTerminationStrategy: PID 13196 died... 11:17:23.349617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13196): Terminated: ok {rc=0} 11:17:23.438513 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:17:24.587188 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:24.599182 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:17:24.666363 tst iperf3m4.py: using LAC 33574 11:17:24.790796 tst iperf3m4.py: using RAC 169 11:17:24.916889 tst iperf3m4.py: using CellId 33574 11:17:25.041640 tst iperf3m4.py: using BVCI 33575 11:17:25.160011 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:25.171449 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:25.182541 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:25.193684 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:25.205086 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:25.216588 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:25.228112 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:25.239490 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:25.251053 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:17:25.369661 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:17:25.490750 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:17:25.607683 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:17:25.723366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:17:25.924343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:17:26.225359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13198): Launched 11:17:26.485941 run iperf3-srv_10.42.42.10(pid=13199): Launched 11:17:26.598984 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:17:26.799050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:17:27.099826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13200): Launched 11:17:27.360675 run iperf3-srv_10.42.42.10(pid=13201): Launched 11:17:27.472775 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:17:27.673811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:17:27.973766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13202): Launched 11:17:28.232875 run iperf3-srv_10.42.42.10(pid=13203): Launched 11:17:28.344756 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:17:28.544693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:17:28.844660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13204): Launched 11:17:29.105355 run iperf3-srv_10.42.42.10(pid=13205): Launched 11:17:29.217127 tst iperf3m4.py:8: start network... 11:17:29.417050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:17:29.880048 run create_hlr_db(pid=13206): Launched 11:17:30.002392 bus /gobi_6: Setting Powered False 11:17:31.079770 run create_hlr_db(pid=13206): Terminated: ok {rc=0} 11:17:31.558819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13208): Launched 11:17:31.882170 run osmo-hlr_10.42.42.2(pid=13209): Launched 11:17:32.115311 run osmo-stp_10.42.42.5: Starting osmo-stp 11:17:32.716177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13211): Launched 11:17:33.038289 run osmo-stp_10.42.42.5(pid=13212): Launched 11:17:33.161279 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:17:33.716191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13214): Launched 11:17:33.839455 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:17:34.113447 run patchelf(pid=13215): Launched 11:17:34.291569 run osmo-stp_10.42.42.5(pid=13212): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13212)] 11:17:34.427995 run osmo-stp_10.42.42.5(pid=13212): stdout: | (launched: 2022-12-13_11:17:32.979241) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:34.565269 run osmo-stp_10.42.42.5(pid=13212): stderr: | 20221213111733169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111733170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111733170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111733170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111733171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111733171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111733171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:34.703672 run osmo-stp_10.42.42.5(pid=13212): stdout: | (launched: 2022-12-13_11:17:32.979241) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:34.835588 run osmo-stp_10.42.42.5(pid=13212): stderr: | 20221213111733169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111733170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111733170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111733170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111733171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111733171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111733171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:34.991822 run patchelf(pid=13215): Terminating (SIGINT) 11:17:35.173800 run patchelf(pid=13215): Terminated: ok {rc=0} 11:17:35.304652 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13212): Process ended prematurely: osmo-stp_10.42.42.5(pid=13212) [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13212)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:17:35.315296 tst iperf3m4.py:8: Test FAILED (10.8 sec) 11:17:35.344367 run osmo-hlr_10.42.42.2(pid=13209): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13209)] 11:17:35.395511 run osmo-hlr_10.42.42.2(pid=13209): stdout: | (launched: 2022-12-13_11:17:31.819225) 11:17:35.447855 run osmo-hlr_10.42.42.2(pid=13209): stderr: | 20221213111732162 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111732163 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111732163 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111732163 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111732163 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111732163 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111732187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111732202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111732202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111732202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:17:35.500265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13198): Terminating (SIGTERM) 11:17:35.542570 run iperf3-srv_10.42.42.10(pid=13199): Terminating (SIGTERM) 11:17:35.585336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13200): Terminating (SIGTERM) 11:17:35.627815 run iperf3-srv_10.42.42.10(pid=13201): Terminating (SIGTERM) 11:17:35.670443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13202): Terminating (SIGTERM) 11:17:35.713096 run iperf3-srv_10.42.42.10(pid=13203): Terminating (SIGTERM) 11:17:35.755687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13204): Terminating (SIGTERM) 11:17:35.798212 run iperf3-srv_10.42.42.10(pid=13205): Terminating (SIGTERM) 11:17:35.840328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13208): Terminating (SIGTERM) 11:17:35.882664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13211): Terminating (SIGTERM) 11:17:35.925013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13214): Terminating (SIGTERM) 11:17:35.967865 --- ParallelTerminationStrategy: PID 13198 died... 11:17:35.988692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13198): Terminated: ok {rc=0} 11:17:36.035958 --- ParallelTerminationStrategy: PID 13199 died... 11:17:36.056201 run iperf3-srv_10.42.42.10(pid=13199): Terminated {rc=256} 11:17:36.102473 --- ParallelTerminationStrategy: PID 13200 died... 11:17:36.122613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13200): Terminated: ok {rc=0} 11:17:36.169260 --- ParallelTerminationStrategy: PID 13201 died... 11:17:36.189392 run iperf3-srv_10.42.42.10(pid=13201): Terminated {rc=256} 11:17:36.235727 --- ParallelTerminationStrategy: PID 13202 died... 11:17:36.256100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13202): Terminated: ok {rc=0} 11:17:36.303273 --- ParallelTerminationStrategy: PID 13203 died... 11:17:36.323518 run iperf3-srv_10.42.42.10(pid=13203): Terminated {rc=256} 11:17:36.370007 --- ParallelTerminationStrategy: PID 13204 died... 11:17:36.390317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13204): Terminated: ok {rc=0} 11:17:36.436903 --- ParallelTerminationStrategy: PID 13205 died... 11:17:36.457152 run iperf3-srv_10.42.42.10(pid=13205): Terminated {rc=256} 11:17:36.503623 --- ParallelTerminationStrategy: PID 13208 died... 11:17:36.523808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13208): Terminated: ok {rc=0} 11:17:36.570100 --- ParallelTerminationStrategy: PID 13211 died... 11:17:36.590412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13211): Terminated: ok {rc=0} 11:17:36.637182 --- ParallelTerminationStrategy: PID 13214 died... 11:17:36.657411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13214): Terminated: ok {rc=0} 11:17:36.746370 bus /gobi_4: Setting Powered False 11:17:37.845964 bus /gobi_4: Setting Powered False 11:17:38.961462 bus /gobi_1: Setting Powered False 11:17:40.059744 bus /gobi_1: Setting Powered False 11:17:41.176625 bus /gobi_0: Setting Powered False 11:17:42.274986 bus /gobi_0: Setting Powered False 11:17:43.394057 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:17:44.496368 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:44.507840 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:17:44.574567 tst ping.py: using LAC 33575 11:17:44.691944 tst ping.py: using RAC 170 11:17:44.808924 tst ping.py: using CellId 33575 11:17:44.924235 tst ping.py: using BVCI 33576 11:17:45.030479 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:45.041498 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:45.052085 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:45.062703 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:45.073357 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:45.084449 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:45.096026 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:45.106806 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:17:45.222153 tst ping.py:19: start network... 11:17:45.434511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:17:45.940123 run create_hlr_db(pid=13216): Launched 11:17:46.095281 bus /gobi_6: Setting Powered False 11:17:47.154002 run create_hlr_db(pid=13216): Terminated: ok {rc=0} 11:17:47.567440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13218): Launched 11:17:47.861197 run osmo-hlr_10.42.42.2(pid=13219): Launched 11:17:47.972544 run osmo-stp_10.42.42.5: Starting osmo-stp 11:17:48.501707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13221): Launched 11:17:48.796033 run osmo-stp_10.42.42.5(pid=13222): Launched 11:17:48.906915 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:17:49.412312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13224): Launched 11:17:49.524515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:17:49.772286 run patchelf(pid=13225): Launched 11:17:49.934871 run osmo-stp_10.42.42.5(pid=13222): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13222)] 11:17:50.059729 run osmo-stp_10.42.42.5(pid=13222): stdout: | (launched: 2022-12-13_11:17:48.741919) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:50.185300 run osmo-stp_10.42.42.5(pid=13222): stderr: | 20221213111748911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111748912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111748912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111748912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111748913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111748913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111748913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:50.311592 run osmo-stp_10.42.42.5(pid=13222): stdout: | (launched: 2022-12-13_11:17:48.741919) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:50.431710 run osmo-stp_10.42.42.5(pid=13222): stderr: | 20221213111748911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111748912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111748912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111748912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111748913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111748913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111748913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:50.574593 run patchelf(pid=13225): Terminating (SIGINT) 11:17:50.741366 run patchelf(pid=13225): Terminated: ok {rc=0} 11:17:50.860448 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13222): Process ended prematurely: osmo-stp_10.42.42.5(pid=13222) [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13222)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 11:17:50.869325 tst ping.py:22: Test FAILED (6.4 sec) 11:17:50.895885 run osmo-hlr_10.42.42.2(pid=13219): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13219)] 11:17:50.943508 run osmo-hlr_10.42.42.2(pid=13219): stdout: | (launched: 2022-12-13_11:17:47.806916) 11:17:50.992504 run osmo-hlr_10.42.42.2(pid=13219): stderr: | 20221213111747983 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111747983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111747983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111747983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111747983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111747983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111747995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111748004 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111748004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111748004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:17:51.041615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13218): Terminating (SIGTERM) 11:17:51.080652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13221): Terminating (SIGTERM) 11:17:51.120045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13224): Terminating (SIGTERM) 11:17:51.159779 --- ParallelTerminationStrategy: PID 13218 died... 11:17:51.178916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13218): Terminated: ok {rc=0} 11:17:51.222576 --- ParallelTerminationStrategy: PID 13221 died... 11:17:51.241153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13221): Terminated: ok {rc=0} 11:17:51.285139 --- ParallelTerminationStrategy: PID 13224 died... 11:17:51.303727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13224): Terminated: ok {rc=0} 11:17:51.388800 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:17:52.476755 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:52.488190 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:17:52.556039 tst ping_idle_ping.py: using LAC 33576 11:17:52.672205 tst ping_idle_ping.py: using RAC 171 11:17:52.787729 tst ping_idle_ping.py: using CellId 33576 11:17:52.902622 tst ping_idle_ping.py: using BVCI 33577 11:17:53.010633 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:53.021520 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:53.032187 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:53.042798 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:53.053370 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:53.063934 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:53.074704 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:17:53.085396 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:17:53.202612 tst ping_idle_ping.py:24: start network... 11:17:53.415480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:17:53.908373 run create_hlr_db(pid=13226): Launched 11:17:54.029809 bus /gobi_6: Setting Powered False 11:17:55.092765 run create_hlr_db(pid=13226): Terminated: ok {rc=0} 11:17:55.534686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13228): Launched 11:17:55.850997 run osmo-hlr_10.42.42.2(pid=13229): Launched 11:17:55.972501 run osmo-stp_10.42.42.5: Starting osmo-stp 11:17:56.517648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13231): Launched 11:17:56.833232 run osmo-stp_10.42.42.5(pid=13232): Launched 11:17:56.954444 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:17:57.500872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13234): Launched 11:17:57.621499 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:17:57.888666 run patchelf(pid=13235): Launched 11:17:58.064941 run osmo-stp_10.42.42.5(pid=13232): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13232)] 11:17:58.199201 run osmo-stp_10.42.42.5(pid=13232): stdout: | (launched: 2022-12-13_11:17:56.775149) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:58.334613 run osmo-stp_10.42.42.5(pid=13232): stderr: | 20221213111756968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111756968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111756968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111756969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111756969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111756969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111756969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:58.470105 run osmo-stp_10.42.42.5(pid=13232): stdout: | (launched: 2022-12-13_11:17:56.775149) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:58.599660 run osmo-stp_10.42.42.5(pid=13232): stderr: | 20221213111756968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111756968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111756968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111756969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111756969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111756969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111756969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:58.753304 run patchelf(pid=13235): Terminating (SIGINT) 11:17:58.931335 run patchelf(pid=13235): Terminated: ok {rc=0} 11:17:59.059880 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13232): Process ended prematurely: osmo-stp_10.42.42.5(pid=13232) [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13232)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:17:59.069357 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 11:17:59.097550 run osmo-hlr_10.42.42.2(pid=13229): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13229)] 11:17:59.147497 run osmo-hlr_10.42.42.2(pid=13229): stdout: | (launched: 2022-12-13_11:17:55.793092) 11:17:59.198941 run osmo-hlr_10.42.42.2(pid=13229): stderr: | 20221213111755989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111755989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111755989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111755989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111755989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111755989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111756005 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111756015 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111756015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111756015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:17:59.250475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13228): Terminating (SIGTERM) 11:17:59.292077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13231): Terminating (SIGTERM) 11:17:59.333969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13234): Terminating (SIGTERM) 11:17:59.375936 --- ParallelTerminationStrategy: PID 13228 died... 11:17:59.396345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13228): Terminated: ok {rc=0} 11:17:59.442486 --- ParallelTerminationStrategy: PID 13231 died... 11:17:59.462272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13231): Terminated: ok {rc=0} 11:17:59.508353 --- ParallelTerminationStrategy: PID 13234 died... 11:17:59.528208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13234): Terminated: ok {rc=0} 11:17:59.615724 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:18:00.926699 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:18:00.934677 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:18:00.967074 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 11:18:01.007118 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 11:18:01.094853 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:18:01.139610 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 11:18:01.186682 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 11:18:01.807059 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 11:18:01.878363 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:01.891448 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:18:01.943126 tst cs_paging_gprs_active.py: using LAC 33577 11:18:02.062298 tst cs_paging_gprs_active.py: using RAC 172 11:18:02.183717 tst cs_paging_gprs_active.py: using CellId 33577 11:18:02.323781 tst cs_paging_gprs_active.py: using BVCI 33578 11:18:02.437592 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:02.449323 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:02.460784 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:02.472224 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:02.484244 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:02.495721 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:02.509076 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:02.522215 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:02.534517 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:18:02.652857 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:18:02.768570 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:18:02.968622 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:18:03.265424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13240): Launched 11:18:03.522695 run iperf3-srv_10.42.42.10(pid=13241): Launched 11:18:03.633720 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:18:03.831244 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:18:04.128043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13242): Launched 11:18:04.385450 run iperf3-srv_10.42.42.10(pid=13243): Launched 11:18:04.495545 tst cs_paging_gprs_active.py:38: start network... 11:18:04.692646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:18:05.152115 run create_hlr_db(pid=13244): Launched 11:18:05.275536 bus /gobi_6: Setting Powered False 11:18:06.335075 run create_hlr_db(pid=13244): Terminated: ok {rc=0} 11:18:06.770329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13246): Launched 11:18:07.088534 run osmo-hlr_10.42.42.2(pid=13247): Launched 11:18:07.210444 run osmo-stp_10.42.42.5: Starting osmo-stp 11:18:07.758975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13249): Launched 11:18:08.076275 run osmo-stp_10.42.42.5(pid=13250): Launched 11:18:08.198421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:18:08.746512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13252): Launched 11:18:08.867661 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:18:09.136773 run patchelf(pid=13253): Launched 11:18:09.313235 run osmo-stp_10.42.42.5(pid=13250): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13250)] 11:18:09.447752 run osmo-stp_10.42.42.5(pid=13250): stdout: | (launched: 2022-12-13_11:18:08.018245) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:09.584460 run osmo-stp_10.42.42.5(pid=13250): stderr: | 20221213111808210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111808210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111808210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111808211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111808211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111808211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111808211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:09.721160 run osmo-stp_10.42.42.5(pid=13250): stdout: | (launched: 2022-12-13_11:18:08.018245) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:09.851564 run osmo-stp_10.42.42.5(pid=13250): stderr: | 20221213111808210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111808210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111808210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111808211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111808211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111808211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111808211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:10.006452 run patchelf(pid=13253): Terminating (SIGINT) 11:18:10.186091 run patchelf(pid=13253): Terminated: ok {rc=0} 11:18:10.315521 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13250): Process ended prematurely: osmo-stp_10.42.42.5(pid=13250) [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13250)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 11:18:10.325734 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 11:18:10.353776 run osmo-hlr_10.42.42.2(pid=13247): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13247)] 11:18:10.404043 run osmo-hlr_10.42.42.2(pid=13247): stdout: | (launched: 2022-12-13_11:18:07.030803) 11:18:10.455964 run osmo-hlr_10.42.42.2(pid=13247): stderr: | 20221213111807232 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111807232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111807232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111807232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111807232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111807232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111807245 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111807253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111807254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111807254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:18:10.507784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13240): Terminating (SIGTERM) 11:18:10.549686 run iperf3-srv_10.42.42.10(pid=13241): Terminating (SIGTERM) 11:18:10.591804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13242): Terminating (SIGTERM) 11:18:10.634260 run iperf3-srv_10.42.42.10(pid=13243): Terminating (SIGTERM) 11:18:10.675922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13246): Terminating (SIGTERM) 11:18:10.718287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13249): Terminating (SIGTERM) 11:18:10.760353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13252): Terminating (SIGTERM) 11:18:10.802826 --- ParallelTerminationStrategy: PID 13240 died... 11:18:10.822798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13240): Terminated: ok {rc=0} 11:18:10.869018 --- ParallelTerminationStrategy: PID 13241 died... 11:18:10.888610 run iperf3-srv_10.42.42.10(pid=13241): Terminated {rc=256} 11:18:10.934113 --- ParallelTerminationStrategy: PID 13242 died... 11:18:10.953597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13242): Terminated: ok {rc=0} 11:18:10.999623 --- ParallelTerminationStrategy: PID 13243 died... 11:18:11.019214 run iperf3-srv_10.42.42.10(pid=13243): Terminated {rc=256} 11:18:11.065436 --- ParallelTerminationStrategy: PID 13246 died... 11:18:11.085197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13246): Terminated: ok {rc=0} 11:18:11.131002 --- ParallelTerminationStrategy: PID 13249 died... 11:18:11.150593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13249): Terminated: ok {rc=0} 11:18:11.196440 --- ParallelTerminationStrategy: PID 13252 died... 11:18:11.216075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13252): Terminated: ok {rc=0} 11:18:11.303767 bus /gobi_0: Setting Powered False 11:18:12.402235 bus /gobi_0: Setting Powered False 11:18:13.517851 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 11:18:14.662212 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:14.674451 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:18:14.724395 tst iperf3.py: using LAC 33578 11:18:14.849250 tst iperf3.py: using RAC 173 11:18:14.975620 tst iperf3.py: using CellId 33578 11:18:15.099954 tst iperf3.py: using BVCI 33579 11:18:15.216573 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:15.228346 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:15.239955 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:15.251411 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:15.263254 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:15.275029 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:15.286958 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:15.298732 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:15.311238 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:18:15.428486 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:18:15.628498 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:18:15.951455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13254): Launched 11:18:16.250283 run iperf3-srv_10.42.42.10(pid=13255): Launched 11:18:16.374840 tst iperf3.py:8: start network... 11:18:16.576515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:18:17.050780 run create_hlr_db(pid=13256): Launched 11:18:17.206451 bus /gobi_6: Setting Powered False 11:18:18.265787 run create_hlr_db(pid=13256): Terminated: ok {rc=0} 11:18:18.700517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13258): Launched 11:18:19.018166 run osmo-hlr_10.42.42.2(pid=13259): Launched 11:18:19.139406 run osmo-stp_10.42.42.5: Starting osmo-stp 11:18:19.684760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13261): Launched 11:18:20.001324 run osmo-stp_10.42.42.5(pid=13262): Launched 11:18:20.123148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:18:20.670920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13264): Launched 11:18:20.792909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:18:21.061958 run patchelf(pid=13265): Launched 11:18:21.238321 run osmo-stp_10.42.42.5(pid=13262): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13262)] 11:18:21.373175 run osmo-stp_10.42.42.5(pid=13262): stdout: | (launched: 2022-12-13_11:18:19.943700) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:21.509542 run osmo-stp_10.42.42.5(pid=13262): stderr: | 20221213111820135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111820135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111820136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111820136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111820138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111820139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111820139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:21.645798 run osmo-stp_10.42.42.5(pid=13262): stdout: | (launched: 2022-12-13_11:18:19.943700) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:21.776313 run osmo-stp_10.42.42.5(pid=13262): stderr: | 20221213111820135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111820135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111820136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111820136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111820138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111820139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111820139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:21.931249 run patchelf(pid=13265): Terminating (SIGINT) 11:18:22.110409 run patchelf(pid=13265): Terminated: ok {rc=0} 11:18:22.239561 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13262): Process ended prematurely: osmo-stp_10.42.42.5(pid=13262) [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13262)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 11:18:22.249702 tst iperf3.py:8: Test FAILED (7.6 sec) 11:18:22.277653 run osmo-hlr_10.42.42.2(pid=13259): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13259)] 11:18:22.328201 run osmo-hlr_10.42.42.2(pid=13259): stdout: | (launched: 2022-12-13_11:18:18.960386) 11:18:22.379996 run osmo-hlr_10.42.42.2(pid=13259): stderr: | 20221213111819159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111819159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111819159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111819159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111819159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111819159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111819174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111819184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111819184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111819184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:18:22.432634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13254): Terminating (SIGTERM) 11:18:22.474213 run iperf3-srv_10.42.42.10(pid=13255): Terminating (SIGTERM) 11:18:22.515705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13258): Terminating (SIGTERM) 11:18:22.557770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13261): Terminating (SIGTERM) 11:18:22.599770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13264): Terminating (SIGTERM) 11:18:22.641359 --- ParallelTerminationStrategy: PID 13254 died... 11:18:22.661386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13254): Terminated: ok {rc=0} 11:18:22.707324 --- ParallelTerminationStrategy: PID 13255 died... 11:18:22.726851 run iperf3-srv_10.42.42.10(pid=13255): Terminated {rc=256} 11:18:22.772293 --- ParallelTerminationStrategy: PID 13258 died... 11:18:22.791882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13258): Terminated: ok {rc=0} 11:18:22.837799 --- ParallelTerminationStrategy: PID 13261 died... 11:18:22.857446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13261): Terminated: ok {rc=0} 11:18:22.903171 --- ParallelTerminationStrategy: PID 13264 died... 11:18:22.922848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13264): Terminated: ok {rc=0} 11:18:23.010745 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 11:18:24.159831 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:24.176444 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:18:24.226730 tst iperf3m4.py: using LAC 33579 11:18:24.350743 tst iperf3m4.py: using RAC 174 11:18:24.474471 tst iperf3m4.py: using CellId 33579 11:18:24.600044 tst iperf3m4.py: using BVCI 33580 11:18:24.715384 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:24.727232 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:24.738801 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:24.750348 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:24.762202 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:24.774058 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:24.785990 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:24.797678 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:24.809879 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:18:24.926821 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:18:25.049508 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:18:25.169103 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:18:25.284274 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:18:25.485312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:18:25.784164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13266): Launched 11:18:26.042192 run iperf3-srv_10.42.42.10(pid=13267): Launched 11:18:26.153196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:18:26.351571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:18:26.648804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13268): Launched 11:18:26.906388 run iperf3-srv_10.42.42.10(pid=13269): Launched 11:18:27.027075 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:18:27.242710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:18:27.562723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13270): Launched 11:18:27.839865 run iperf3-srv_10.42.42.10(pid=13271): Launched 11:18:27.959267 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:18:28.173865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:18:28.493265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13272): Launched 11:18:28.769138 run iperf3-srv_10.42.42.10(pid=13273): Launched 11:18:28.887867 tst iperf3m4.py:8: start network... 11:18:29.102762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:18:29.593541 run create_hlr_db(pid=13274): Launched 11:18:29.713947 bus /gobi_6: Setting Powered False 11:18:30.777188 run create_hlr_db(pid=13274): Terminated: ok {rc=0} 11:18:31.236622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13276): Launched 11:18:31.560504 run osmo-hlr_10.42.42.2(pid=13277): Launched 11:18:31.803078 run osmo-stp_10.42.42.5: Starting osmo-stp 11:18:32.514549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13279): Launched 11:18:32.832820 run osmo-stp_10.42.42.5(pid=13280): Launched 11:18:32.955070 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:18:33.505462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13282): Launched 11:18:33.626867 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:18:33.894426 run patchelf(pid=13283): Launched 11:18:34.070969 run osmo-stp_10.42.42.5(pid=13280): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13280)] 11:18:34.205839 run osmo-stp_10.42.42.5(pid=13280): stdout: | (launched: 2022-12-13_11:18:32.774766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:34.341888 run osmo-stp_10.42.42.5(pid=13280): stderr: | 20221213111832964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111832964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111832965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111832965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111832966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111832966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111832966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:34.478004 run osmo-stp_10.42.42.5(pid=13280): stdout: | (launched: 2022-12-13_11:18:32.774766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:34.608084 run osmo-stp_10.42.42.5(pid=13280): stderr: | 20221213111832964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111832964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111832965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111832965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111832966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111832966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111832966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:34.762732 run patchelf(pid=13283): Terminating (SIGINT) 11:18:34.940699 run patchelf(pid=13283): Terminated: ok {rc=0} 11:18:35.070442 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13280): Process ended prematurely: osmo-stp_10.42.42.5(pid=13280) [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13280)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 11:18:35.080726 tst iperf3m4.py:8: Test FAILED (11.0 sec) 11:18:35.109504 run osmo-hlr_10.42.42.2(pid=13277): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13277)] 11:18:35.159680 run osmo-hlr_10.42.42.2(pid=13277): stdout: | (launched: 2022-12-13_11:18:31.496594) 11:18:35.211407 run osmo-hlr_10.42.42.2(pid=13277): stderr: | 20221213111831842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111831842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111831842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111831842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111831842 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111831842 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111831862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111831872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111831872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111831872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:18:35.263587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13266): Terminating (SIGTERM) 11:18:35.305350 run iperf3-srv_10.42.42.10(pid=13267): Terminating (SIGTERM) 11:18:35.347026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13268): Terminating (SIGTERM) 11:18:35.388825 run iperf3-srv_10.42.42.10(pid=13269): Terminating (SIGTERM) 11:18:35.430399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13270): Terminating (SIGTERM) 11:18:35.471854 run iperf3-srv_10.42.42.10(pid=13271): Terminating (SIGTERM) 11:18:35.513354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13272): Terminating (SIGTERM) 11:18:35.554910 run iperf3-srv_10.42.42.10(pid=13273): Terminating (SIGTERM) 11:18:35.596365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13276): Terminating (SIGTERM) 11:18:35.637961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13279): Terminating (SIGTERM) 11:18:35.679375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13282): Terminating (SIGTERM) 11:18:35.721196 --- ParallelTerminationStrategy: PID 13266 died... 11:18:35.741268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13266): Terminated: ok {rc=0} 11:18:35.787347 --- ParallelTerminationStrategy: PID 13267 died... 11:18:35.806967 run iperf3-srv_10.42.42.10(pid=13267): Terminated {rc=256} 11:18:35.852755 --- ParallelTerminationStrategy: PID 13268 died... 11:18:35.872312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13268): Terminated: ok {rc=0} 11:18:35.917962 --- ParallelTerminationStrategy: PID 13269 died... 11:18:35.937595 run iperf3-srv_10.42.42.10(pid=13269): Terminated {rc=256} 11:18:35.983249 --- ParallelTerminationStrategy: PID 13270 died... 11:18:36.002970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13270): Terminated: ok {rc=0} 11:18:36.049291 --- ParallelTerminationStrategy: PID 13271 died... 11:18:36.068896 run iperf3-srv_10.42.42.10(pid=13271): Terminated {rc=256} 11:18:36.114903 --- ParallelTerminationStrategy: PID 13272 died... 11:18:36.134607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13272): Terminated: ok {rc=0} 11:18:36.180532 --- ParallelTerminationStrategy: PID 13273 died... 11:18:36.200158 run iperf3-srv_10.42.42.10(pid=13273): Terminated {rc=256} 11:18:36.246311 --- ParallelTerminationStrategy: PID 13276 died... 11:18:36.266046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13276): Terminated: ok {rc=0} 11:18:36.311880 --- ParallelTerminationStrategy: PID 13279 died... 11:18:36.331535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13279): Terminated: ok {rc=0} 11:18:36.377358 --- ParallelTerminationStrategy: PID 13282 died... 11:18:36.397013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13282): Terminated: ok {rc=0} 11:18:36.484461 bus /gobi_4: Setting Powered False 11:18:37.583113 bus /gobi_4: Setting Powered False 11:18:38.698155 bus /gobi_1: Setting Powered False 11:18:39.795673 bus /gobi_1: Setting Powered False 11:18:40.910492 bus /gobi_0: Setting Powered False 11:18:42.008256 bus /gobi_0: Setting Powered False 11:18:43.126282 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 11:18:44.225382 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:44.237130 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:18:44.285292 tst ping.py: using LAC 33580 11:18:44.399892 tst ping.py: using RAC 175 11:18:44.513776 tst ping.py: using CellId 33580 11:18:44.627699 tst ping.py: using BVCI 33581 11:18:44.732269 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:44.743746 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:44.754857 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:44.766115 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:44.777771 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:44.788783 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:44.799960 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:44.811241 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:18:44.925424 tst ping.py:19: start network... 11:18:45.118657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:18:45.568799 run create_hlr_db(pid=13284): Launched 11:18:45.687792 bus /gobi_6: Setting Powered False 11:18:46.744685 run create_hlr_db(pid=13284): Terminated: ok {rc=0} 11:18:47.187445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13286): Launched 11:18:47.485503 run osmo-hlr_10.42.42.2(pid=13287): Launched 11:18:47.597273 run osmo-stp_10.42.42.5: Starting osmo-stp 11:18:48.098907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13289): Launched 11:18:48.389330 run osmo-stp_10.42.42.5(pid=13290): Launched 11:18:48.499036 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:18:49.001749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13292): Launched 11:18:49.112830 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:18:49.358711 run patchelf(pid=13293): Launched 11:18:49.520339 run osmo-stp_10.42.42.5(pid=13290): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13290)] 11:18:49.643735 run osmo-stp_10.42.42.5(pid=13290): stdout: | (launched: 2022-12-13_11:18:48.335812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:49.768631 run osmo-stp_10.42.42.5(pid=13290): stderr: | 20221213111848505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111848505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111848505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111848506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111848506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111848506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111848506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:49.893880 run osmo-stp_10.42.42.5(pid=13290): stdout: | (launched: 2022-12-13_11:18:48.335812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:50.013414 run osmo-stp_10.42.42.5(pid=13290): stderr: | 20221213111848505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111848505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111848505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111848506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111848506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111848506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111848506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:50.155031 run patchelf(pid=13293): Terminating (SIGINT) 11:18:50.319016 run patchelf(pid=13293): Terminated: ok {rc=0} 11:18:50.437519 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13290): Process ended prematurely: osmo-stp_10.42.42.5(pid=13290) [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13290)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 11:18:50.446285 tst ping.py:22: Test FAILED (6.2 sec) 11:18:50.472513 run osmo-hlr_10.42.42.2(pid=13287): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13287)] 11:18:50.520438 run osmo-hlr_10.42.42.2(pid=13287): stdout: | (launched: 2022-12-13_11:18:47.428644) 11:18:50.569436 run osmo-hlr_10.42.42.2(pid=13287): stderr: | 20221213111847603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111847603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111847603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111847603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111847603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111847604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111847616 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111847625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111847625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111847625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:18:50.619115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13286): Terminating (SIGTERM) 11:18:50.658491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13289): Terminating (SIGTERM) 11:18:50.697975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13292): Terminating (SIGTERM) 11:18:50.737714 --- ParallelTerminationStrategy: PID 13286 died... 11:18:50.756886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13286): Terminated: ok {rc=0} 11:18:50.800651 --- ParallelTerminationStrategy: PID 13289 died... 11:18:50.819381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13289): Terminated: ok {rc=0} 11:18:50.863180 --- ParallelTerminationStrategy: PID 13292 died... 11:18:50.881853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13292): Terminated: ok {rc=0} 11:18:50.967205 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 11:18:52.055554 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:52.067571 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:18:52.118879 tst ping_idle_ping.py: using LAC 33581 11:18:52.236338 tst ping_idle_ping.py: using RAC 176 11:18:52.351853 tst ping_idle_ping.py: using CellId 33581 11:18:52.466664 tst ping_idle_ping.py: using BVCI 33582 11:18:52.572734 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:52.584182 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:52.595370 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:52.606579 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:52.618113 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:52.629775 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:52.641498 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:18:52.653116 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:18:52.771862 tst ping_idle_ping.py:24: start network... 11:18:52.983043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:18:53.472351 run create_hlr_db(pid=13294): Launched 11:18:53.592198 bus /gobi_6: Setting Powered False 11:18:54.655289 run create_hlr_db(pid=13294): Terminated: ok {rc=0} 11:18:55.093639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13296): Launched 11:18:55.406846 run osmo-hlr_10.42.42.2(pid=13297): Launched 11:18:55.527194 run osmo-stp_10.42.42.5: Starting osmo-stp 11:18:56.068343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13299): Launched 11:18:56.381620 run osmo-stp_10.42.42.5(pid=13300): Launched 11:18:56.501866 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:18:57.046285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13302): Launched 11:18:57.166499 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:18:57.431694 run patchelf(pid=13303): Launched 11:18:57.605653 run osmo-stp_10.42.42.5(pid=13300): ERR: Terminated: ERROR {rc=1} [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13300)] 11:18:57.738783 run osmo-stp_10.42.42.5(pid=13300): stdout: | (launched: 2022-12-13_11:18:56.324361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:57.873248 run osmo-stp_10.42.42.5(pid=13300): stderr: | 20221213111856514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111856514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111856515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111856515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111856516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111856516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111856516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:58.007670 run osmo-stp_10.42.42.5(pid=13300): stdout: | (launched: 2022-12-13_11:18:56.324361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:18:58.137183 run osmo-stp_10.42.42.5(pid=13300): stderr: | 20221213111856514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111856514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111856515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111856515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111856516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111856516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111856516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:18:58.289717 run patchelf(pid=13303): Terminating (SIGINT) 11:18:58.466076 run patchelf(pid=13303): Terminated: ok {rc=0} 11:18:58.593414 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13300): Process ended prematurely: osmo-stp_10.42.42.5(pid=13300) [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13300)] [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 11:18:58.603057 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:18:58.630730 run osmo-hlr_10.42.42.2(pid=13297): ERR: Terminated: ERROR {rc=237} [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13297)] 11:18:58.681076 run osmo-hlr_10.42.42.2(pid=13297): stdout: | (launched: 2022-12-13_11:18:55.349753) 11:18:58.732754 run osmo-hlr_10.42.42.2(pid=13297): stderr: | 20221213111855545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111855545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111855545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111855545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111855545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111855545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111855558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111855568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111855568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111855568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:18:58.785084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13296): Terminating (SIGTERM) 11:18:58.826823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13299): Terminating (SIGTERM) 11:18:58.868722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13302): Terminating (SIGTERM) 11:18:58.911328 --- ParallelTerminationStrategy: PID 13296 died... 11:18:58.931552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13296): Terminated: ok {rc=0} 11:18:58.977864 --- ParallelTerminationStrategy: PID 13299 died... 11:18:58.997509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13299): Terminated: ok {rc=0} 11:18:59.043684 --- ParallelTerminationStrategy: PID 13302 died... 11:18:59.063758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13302): Terminated: ok {rc=0} 11:18:59.151721 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 11:19:00.463392 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:19:00.473214 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:19:00.507090 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:19:00.542237 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:19:00.595584 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:19:00.627828 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:19:00.662772 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:19:01.245511 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2388 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:19:01.254504 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:19:01.270144 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:19:01.350428 tst switch_tch_pdch.py: using LAC 33582 11:19:01.508029 tst switch_tch_pdch.py: using RAC 177 11:19:01.661187 tst switch_tch_pdch.py: using CellId 33582 11:19:01.790098 tst switch_tch_pdch.py: using BVCI 33583 11:19:01.910146 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:19:01.923423 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:19:01.936467 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:19:01.949872 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:19:01.963789 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:19:01.978165 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:19:01.992803 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:19:02.007874 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:19:02.132365 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:19:02.254851 tst switch_tch_pdch.py:51: start network... 11:19:02.467707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:19:02.952545 run create_hlr_db(pid=13307): Launched 11:19:03.072753 bus /gobi_6: Setting Powered False 11:19:04.135273 run create_hlr_db(pid=13307): Terminated: ok {rc=0} 11:19:04.552247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13309): Launched 11:19:04.842805 run osmo-hlr_10.42.42.2(pid=13310): Launched 11:19:04.953358 run osmo-stp_10.42.42.5: Starting osmo-stp 11:19:05.469683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13312): Launched 11:19:05.760244 run osmo-stp_10.42.42.5(pid=13313): Launched 11:19:05.871007 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:19:06.373255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13315): Launched 11:19:06.484137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:19:06.729699 run patchelf(pid=13316): Launched 11:19:06.891823 run osmo-stp_10.42.42.5(pid=13313): ERR: Terminated: ERROR {rc=1} [trial-2388↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13313)] 11:19:07.015558 run osmo-stp_10.42.42.5(pid=13313): stdout: | (launched: 2022-12-13_11:19:05.706607) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:07.140905 run osmo-stp_10.42.42.5(pid=13313): stderr: | 20221213111905877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111905877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111905878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111905878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111905878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111905878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111905879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:07.265969 run osmo-stp_10.42.42.5(pid=13313): stdout: | (launched: 2022-12-13_11:19:05.706607) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:07.386570 run osmo-stp_10.42.42.5(pid=13313): stderr: | 20221213111905877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111905877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111905878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111905878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111905878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111905878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111905879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:07.528872 run patchelf(pid=13316): Terminating (SIGINT) 11:19:07.693333 run patchelf(pid=13316): Terminated: ok {rc=0} 11:19:07.811675 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13313): Process ended prematurely: osmo-stp_10.42.42.5(pid=13313) [trial-2388↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13313)] [trial-2388↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:19:07.820592 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 11:19:07.846646 run osmo-hlr_10.42.42.2(pid=13310): ERR: Terminated: ERROR {rc=237} [trial-2388↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13310)] 11:19:07.894076 run osmo-hlr_10.42.42.2(pid=13310): stdout: | (launched: 2022-12-13_11:19:04.789679) 11:19:07.942872 run osmo-hlr_10.42.42.2(pid=13310): stderr: | 20221213111904962 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111904962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111904962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111904962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111904962 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111904962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111904974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111904985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111904985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111904985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:07.991845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13309): Terminating (SIGTERM) 11:19:08.031485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13312): Terminating (SIGTERM) 11:19:08.070954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13315): Terminating (SIGTERM) 11:19:08.110751 --- ParallelTerminationStrategy: PID 13309 died... 11:19:08.129882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13309): Terminated: ok {rc=0} 11:19:08.173533 --- ParallelTerminationStrategy: PID 13312 died... 11:19:08.191953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13312): Terminated: ok {rc=0} 11:19:08.235526 --- ParallelTerminationStrategy: PID 13315 died... 11:19:08.254258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13315): Terminated: ok {rc=0} 11:19:08.339455 bus /gobi_0: Setting Powered False 11:19:09.438615 bus /gobi_0: Setting Powered False 11:19:10.552818 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2388 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 nitb_smpp --------------------------------------------------------------------- 11:19:11.804710 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:19:11.807299 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 11:19:11.827543 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 11:19:11.834381 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 11:19:11.868154 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 11:19:11.888928 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 11:19:11.895631 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 11:19:12.415131 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2388 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 11:19:12.420301 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:19:12.438888 tst esme_connect_policy_acceptall.py: using MSISDN 8123 11:19:12.568354 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:19:13.122496 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13322): Launched 11:19:13.419559 run osmo-nitb_10.42.42.2(pid=13323): Launched 11:19:13.584317 run osmo-nitb_10.42.42.2(pid=13323): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13323)] 11:19:13.717621 run osmo-nitb_10.42.42.2(pid=13323): stdout: | (launched: 2022-12-13_11:19:13.364763) 11:19:13.852448 run osmo-nitb_10.42.42.2(pid=13323): stderr: | (launched: 2022-12-13_11:19:13.409448) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:19:13.987269 run osmo-nitb_10.42.42.2(pid=13323): stdout: | (launched: 2022-12-13_11:19:13.364763) 11:19:14.116449 run osmo-nitb_10.42.42.2(pid=13323): stderr: | (launched: 2022-12-13_11:19:13.409448) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13323): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13323) [trial-2388↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13323)] 11:19:14.531797 tst osmo-nitb_10.42.42.2(pid=13323): stdout: | (launched: 2022-12-13_11:19:13.364763) 11:19:14.652891 tst osmo-nitb_10.42.42.2(pid=13323): stderr: | (launched: 2022-12-13_11:19:13.409448) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:19:14.795476 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=13323): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13323) [trial-2388↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13323)] [trial-2388↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 11:19:14.803885 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 11:19:14.810494 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13322): Terminating (SIGTERM) 11:19:15.019460 --- ParallelTerminationStrategy: PID 13322 died... 11:19:15.040118 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13322): Terminated: ok {rc=0} ---------------------------------------------- trial-2388 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 11:19:15.088773 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:19:15.109699 tst esme_connect_policy_closed.py: using MSISDN 8124 11:19:15.230214 tst esme_connect_policy_closed.py: using MSISDN 8125 11:19:15.339317 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:19:15.915589 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13324): Launched 11:19:16.297966 run osmo-nitb_10.42.42.2(pid=13325): Launched 11:19:16.504596 run osmo-nitb_10.42.42.2(pid=13325): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13325)] 11:19:16.651394 run osmo-nitb_10.42.42.2(pid=13325): stdout: | (launched: 2022-12-13_11:19:16.224110) 11:19:16.801434 run osmo-nitb_10.42.42.2(pid=13325): stderr: | (launched: 2022-12-13_11:19:16.282314) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:19:16.940228 run osmo-nitb_10.42.42.2(pid=13325): stdout: | (launched: 2022-12-13_11:19:16.224110) 11:19:17.099014 run osmo-nitb_10.42.42.2(pid=13325): stderr: | (launched: 2022-12-13_11:19:16.282314) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:19:17.281482 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=13325): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13325) [trial-2388↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13325)] [trial-2388↪nitb_smpp↪esme_connect_policy_closed.py:24] 11:19:17.290032 tst esme_connect_policy_closed.py:24: Test FAILED (2.2 sec) 11:19:17.296726 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13324): Terminating (SIGTERM) 11:19:17.506499 --- ParallelTerminationStrategy: PID 13324 died... 11:19:17.527515 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13324): Terminated: ok {rc=0} ---------------------------------------------- trial-2388 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 11:19:17.575799 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:19:17.586791 tst nitb_smpp: Using 1 x bts (candidates: 1) 11:19:17.621676 tst esme_ms_sms_storeforward.py: using LAC 33583 11:19:17.740676 tst esme_ms_sms_storeforward.py: using RAC 178 11:19:17.859848 tst esme_ms_sms_storeforward.py: using CellId 33583 11:19:17.985747 tst esme_ms_sms_storeforward.py: using BVCI 33584 11:19:18.104871 tst nitb_smpp: Using 1 x modem (candidates: 1) 11:19:18.231393 tst esme_ms_sms_storeforward.py: using MSISDN 8126 11:19:18.339975 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 11:19:18.540309 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:19:19.149751 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13326): Launched 11:19:19.449285 run osmo-nitb_10.42.42.2(pid=13327): Launched 11:19:19.610516 run osmo-nitb_10.42.42.2(pid=13327): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13327)] 11:19:19.733577 run osmo-nitb_10.42.42.2(pid=13327): stdout: | (launched: 2022-12-13_11:19:19.393830) 11:19:19.858235 run osmo-nitb_10.42.42.2(pid=13327): stderr: | (launched: 2022-12-13_11:19:19.439222) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:19:19.982762 run osmo-nitb_10.42.42.2(pid=13327): stdout: | (launched: 2022-12-13_11:19:19.393830) 11:19:20.102175 run osmo-nitb_10.42.42.2(pid=13327): stderr: | (launched: 2022-12-13_11:19:19.439222) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:19:20.244659 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=13327): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13327) [trial-2388↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13327)] [trial-2388↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 11:19:20.252704 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.7 sec) 11:19:20.259068 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13326): Terminating (SIGTERM) 11:19:20.466815 --- ParallelTerminationStrategy: PID 13326 died... 11:19:20.487399 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13326): Terminated: ok {rc=0} 11:19:20.572372 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 11:19:21.660645 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:19:21.672070 tst nitb_smpp: Using 1 x bts (candidates: 1) 11:19:21.707840 tst esme_ms_sms_transaction.py: using LAC 33584 11:19:21.834160 tst esme_ms_sms_transaction.py: using RAC 179 11:19:21.959909 tst esme_ms_sms_transaction.py: using CellId 33584 11:19:22.084750 tst esme_ms_sms_transaction.py: using BVCI 33585 11:19:22.203032 tst nitb_smpp: Using 1 x modem (candidates: 1) 11:19:22.333325 tst esme_ms_sms_transaction.py: using MSISDN 8127 11:19:22.450267 tst esme_ms_sms_transaction.py:18: start nitb and bts... 11:19:22.666492 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:19:23.317500 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13328): Launched 11:19:23.635695 run osmo-nitb_10.42.42.2(pid=13329): Launched 11:19:23.812098 run osmo-nitb_10.42.42.2(pid=13329): ERR: Terminated: ERROR {rc=2} [trial-2388↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13329)] 11:19:23.954707 run osmo-nitb_10.42.42.2(pid=13329): stdout: | (launched: 2022-12-13_11:19:23.578287) 11:19:24.099472 run osmo-nitb_10.42.42.2(pid=13329): stderr: | (launched: 2022-12-13_11:19:23.625683) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:19:24.244161 run osmo-nitb_10.42.42.2(pid=13329): stdout: | (launched: 2022-12-13_11:19:23.578287) 11:19:24.382929 run osmo-nitb_10.42.42.2(pid=13329): stderr: | (launched: 2022-12-13_11:19:23.625683) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13329): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13329) [trial-2388↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13329)] 11:19:24.756378 tst osmo-nitb_10.42.42.2(pid=13329): stdout: | (launched: 2022-12-13_11:19:23.578287) 11:19:24.886103 tst osmo-nitb_10.42.42.2(pid=13329): stderr: | (launched: 2022-12-13_11:19:23.625683) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:19:25.038717 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=13329): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13329) [trial-2388↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13329)] [trial-2388↪nitb_smpp↪esme_ms_sms_transaction.py:21] 11:19:25.047625 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 11:19:25.054545 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13328): Terminating (SIGTERM) 11:19:25.266090 --- ParallelTerminationStrategy: PID 13328 died... 11:19:25.286215 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13328): Terminated: ok {rc=0} 11:19:25.371925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 smpp --------------------------------------------------------------------- 11:19:26.540707 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:19:26.543416 tst smpp: Verifying 1 x bts (candidates: 11) 11:19:26.563668 tst smpp: Verifying 6 x ip_address (candidates: 9) 11:19:26.589908 tst smpp: Verifying 1 x modem (candidates: 12) 11:19:26.626041 tst smpp: Reserving 1 x bts (candidates: 11) 11:19:26.646154 tst smpp: Reserving 6 x ip_address (candidates: 9) 11:19:26.671808 tst smpp: Reserving 1 x modem (candidates: 12) 11:19:27.197342 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2388 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 11:19:27.202165 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:27.212310 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:27.222514 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:27.232494 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:27.250420 tst esme_connect_policy_acceptall.py: using MSISDN 8128 11:19:27.369733 run osmo-stp_10.42.42.4: Starting osmo-stp 11:19:27.914758 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13333): Launched 11:19:28.234541 run osmo-stp_10.42.42.4(pid=13334): Launched 11:19:28.357231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:19:28.853306 run create_hlr_db(pid=13335): Launched 11:19:28.975430 bus /sierra_2: Setting Powered False 11:19:30.037970 run create_hlr_db(pid=13335): Terminated: ok {rc=0} 11:19:30.484063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13337): Launched 11:19:30.803545 run osmo-hlr_10.42.42.2(pid=13338): Launched 11:19:31.032439 run osmo-msc_10.42.42.5: Starting osmo-msc 11:19:31.728207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13340): Launched 11:19:32.081728 run osmo-msc_10.42.42.5(pid=13341): Launched 11:19:32.448658 run osmo-hlr_10.42.42.2(pid=13338): ERR: Terminated: ERROR {rc=237} [trial-2388↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13338)] 11:19:32.580428 run osmo-hlr_10.42.42.2(pid=13338): stdout: | (launched: 2022-12-13_11:19:30.745409) 11:19:32.708795 run osmo-hlr_10.42.42.2(pid=13338): stderr: | 20221213111930999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111930999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111930999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111930999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111930999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111931000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111931023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111931051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111931052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111931052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:32.834580 run osmo-hlr_10.42.42.2(pid=13338): stdout: | (launched: 2022-12-13_11:19:30.745409) 11:19:32.955416 run osmo-hlr_10.42.42.2(pid=13338): stderr: | 20221213111930999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111930999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111930999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111930999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111930999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111931000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111931023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111931051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111931052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111931052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:33.099144 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=13338): Process ended prematurely: osmo-hlr_10.42.42.2(pid=13338) [trial-2388↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13338)] [trial-2388↪smpp↪esme_connect_policy_acceptall.py:23] 11:19:33.107495 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.9 sec) 11:19:33.133039 run osmo-msc_10.42.42.5(pid=13341): ERR: Terminated: ERROR {rc=9} [trial-2388↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=13341)] 11:19:33.181286 run osmo-msc_10.42.42.5(pid=13341): stdout: | (launched: 2022-12-13_11:19:32.014458) 11:19:33.231597 run osmo-msc_10.42.42.5(pid=13341): stderr: | 20221213111932501 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221213111932501 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221213111932501 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111932501 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221213111932501 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221213111932502 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221213111932502 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221213111932502 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213111932502 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 11:19:33.281869 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13333): Terminating (SIGTERM) 11:19:33.321927 run osmo-stp_10.42.42.4(pid=13334): Terminating (SIGTERM) 11:19:33.362188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13337): Terminating (SIGTERM) 11:19:33.404441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13340): Terminating (SIGTERM) 11:19:33.447808 --- ParallelTerminationStrategy: PID 13333 died... 11:19:33.467358 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13333): Terminated: ok {rc=0} 11:19:33.512242 --- ParallelTerminationStrategy: PID 13334 died... 11:19:33.532089 run osmo-stp_10.42.42.4(pid=13334): Terminated: ok {rc=0} 11:19:33.576551 --- ParallelTerminationStrategy: PID 13337 died... 11:19:33.595779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13337): Terminated: ok {rc=0} 11:19:33.640281 --- ParallelTerminationStrategy: PID 13340 died... 11:19:33.659398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13340): Terminated: ok {rc=0} ---------------------------------------------- trial-2388 smpp esme_connect_policy_closed.py ---------------------------------------------- 11:19:33.708724 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:33.720081 tst smpp: Using 1 x bts (candidates: 1) 11:19:33.754536 tst esme_connect_policy_closed.py: using LAC 33585 11:19:33.874973 tst esme_connect_policy_closed.py: using RAC 180 11:19:33.992225 tst esme_connect_policy_closed.py: using CellId 33585 11:19:34.109540 tst esme_connect_policy_closed.py: using BVCI 33586 11:19:34.228062 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:34.239003 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:34.249815 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:34.269892 tst esme_connect_policy_closed.py: using MSISDN 8129 11:19:34.389541 tst esme_connect_policy_closed.py: using MSISDN 8130 11:19:34.499551 run osmo-stp_10.42.42.4: Starting osmo-stp 11:19:35.008094 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13344): Launched 11:19:35.306764 run osmo-stp_10.42.42.4(pid=13345): Launched 11:19:35.421328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:19:35.885620 run create_hlr_db(pid=13346): Launched 11:19:37.062523 run create_hlr_db(pid=13346): Terminated: ok {rc=0} 11:19:37.378084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13348): Launched 11:19:37.677840 run osmo-hlr_10.42.42.2(pid=13349): Launched 11:19:37.791495 run osmo-msc_10.42.42.5: Starting osmo-msc 11:19:38.338060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13351): Launched 11:19:38.637260 run osmo-msc_10.42.42.5(pid=13352): Launched 11:19:38.803805 run osmo-hlr_10.42.42.2(pid=13349): ERR: Terminated: ERROR {rc=237} [trial-2388↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13349)] 11:19:38.932038 run osmo-hlr_10.42.42.2(pid=13349): stdout: | (launched: 2022-12-13_11:19:37.622947) 11:19:39.060801 run osmo-hlr_10.42.42.2(pid=13349): stderr: | 20221213111937797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111937797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111937797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111937797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111937798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111937798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111937810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111937818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111937819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111937819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:39.185560 run osmo-hlr_10.42.42.2(pid=13349): stdout: | (launched: 2022-12-13_11:19:37.622947) 11:19:39.304713 run osmo-hlr_10.42.42.2(pid=13349): stderr: | 20221213111937797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111937797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111937797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111937797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111937798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111937798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111937810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111937818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111937819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111937819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:39.447800 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=13349): Process ended prematurely: osmo-hlr_10.42.42.2(pid=13349) [trial-2388↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13349)] [trial-2388↪smpp↪esme_connect_policy_closed.py:31] 11:19:39.455781 tst esme_connect_policy_closed.py:31: Test FAILED (5.7 sec) 11:19:39.481110 run osmo-msc_10.42.42.5(pid=13352): ERR: Terminated: ERROR {rc=9} [trial-2388↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=13352)] 11:19:39.528168 run osmo-msc_10.42.42.5(pid=13352): stdout: | (launched: 2022-12-13_11:19:38.582036) 11:19:39.577575 run osmo-msc_10.42.42.5(pid=13352): stderr: | 20221213111938897 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221213111938897 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221213111938898 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111938898 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221213111938898 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221213111938898 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221213111938898 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221213111938898 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213111938898 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 11:19:39.627017 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13344): Terminating (SIGTERM) 11:19:39.666060 run osmo-stp_10.42.42.4(pid=13345): Terminating (SIGTERM) 11:19:39.705075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13348): Terminating (SIGTERM) 11:19:39.745774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13351): Terminating (SIGTERM) 11:19:39.786498 --- ParallelTerminationStrategy: PID 13344 died... 11:19:39.805585 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13344): Terminated: ok {rc=0} 11:19:39.849477 --- ParallelTerminationStrategy: PID 13345 died... 11:19:39.867795 run osmo-stp_10.42.42.4(pid=13345): Terminated: ok {rc=0} 11:19:39.911142 --- ParallelTerminationStrategy: PID 13348 died... 11:19:39.929638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13348): Terminated: ok {rc=0} 11:19:39.973141 --- ParallelTerminationStrategy: PID 13351 died... 11:19:39.991531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13351): Terminated: ok {rc=0} ---------------------------------------------- trial-2388 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 11:19:40.039527 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:40.050374 tst smpp: Using 1 x bts (candidates: 1) 11:19:40.084831 tst esme_ms_sms_storeforward.py: using LAC 33586 11:19:40.204791 tst esme_ms_sms_storeforward.py: using RAC 181 11:19:40.325696 tst esme_ms_sms_storeforward.py: using CellId 33586 11:19:40.443326 tst esme_ms_sms_storeforward.py: using BVCI 33587 11:19:40.552392 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:40.562846 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:40.572942 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:40.583099 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:40.593136 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:40.603641 tst smpp: Using 1 x modem (candidates: 1) 11:19:40.732443 tst esme_ms_sms_storeforward.py: using MSISDN 8131 11:19:40.842784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:19:41.308457 run create_hlr_db(pid=13355): Launched 11:19:42.484835 run create_hlr_db(pid=13355): Terminated: ok {rc=0} 11:19:42.801758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13357): Launched 11:19:43.101442 run osmo-hlr_10.42.42.2(pid=13358): Launched 11:19:43.216027 run osmo-stp_10.42.42.5: Starting osmo-stp 11:19:43.734138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13360): Launched 11:19:44.034240 run osmo-stp_10.42.42.5(pid=13361): Launched 11:19:44.148502 run osmo-msc_10.42.42.6: Starting osmo-msc 11:19:44.690521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13363): Launched 11:19:44.989920 run osmo-msc_10.42.42.6(pid=13364): Launched 11:19:45.157557 run osmo-stp_10.42.42.5(pid=13361): ERR: Terminated: ERROR {rc=1} [trial-2388↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13361)] 11:19:45.285234 run osmo-stp_10.42.42.5(pid=13361): stdout: | (launched: 2022-12-13_11:19:43.979239) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:45.412299 run osmo-stp_10.42.42.5(pid=13361): stderr: | 20221213111944151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111944151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111944151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111944152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111944152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111944152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111944152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:45.537948 run osmo-stp_10.42.42.5(pid=13361): stdout: | (launched: 2022-12-13_11:19:43.979239) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:45.659000 run osmo-stp_10.42.42.5(pid=13361): stderr: | 20221213111944151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111944151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111944151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111944152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111944152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111944152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111944152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:45.802733 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=13361): Process ended prematurely: osmo-stp_10.42.42.5(pid=13361) [trial-2388↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13361)] [trial-2388↪smpp↪esme_ms_sms_storeforward.py:30] 11:19:45.810743 tst esme_ms_sms_storeforward.py:30: Test FAILED (5.8 sec) 11:19:45.836362 run osmo-hlr_10.42.42.2(pid=13358): ERR: Terminated: ERROR {rc=237} [trial-2388↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13358)] 11:19:45.905439 run osmo-hlr_10.42.42.2(pid=13358): stdout: | (launched: 2022-12-13_11:19:43.046281) 11:19:45.966772 run osmo-hlr_10.42.42.2(pid=13358): stderr: | 20221213111943224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111943224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111943224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111943224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111943224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111943224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111943236 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111943245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111943245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111943245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:46.036326 run osmo-msc_10.42.42.6(pid=13364): ERR: Terminated: ERROR {rc=2} [trial-2388↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13364)] 11:19:46.084548 run osmo-msc_10.42.42.6(pid=13364): stdout: | (launched: 2022-12-13_11:19:44.934681) 11:19:46.134632 run osmo-msc_10.42.42.6(pid=13364): stderr: | 20221213111945208 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111945208 DLGLOBAL DEBUG validating counter group 0x7fa0c34dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111945208 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111945208 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111945208 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111945209 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111945210 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111945211 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111945211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111945211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:19:46.184812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13357): Terminating (SIGTERM) 11:19:46.226722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13360): Terminating (SIGTERM) 11:19:46.269200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13363): Terminating (SIGTERM) 11:19:46.310006 --- ParallelTerminationStrategy: PID 13357 died... 11:19:46.329360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13357): Terminated: ok {rc=0} 11:19:46.374001 --- ParallelTerminationStrategy: PID 13360 died... 11:19:46.392939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13360): Terminated: ok {rc=0} 11:19:46.437497 --- ParallelTerminationStrategy: PID 13363 died... 11:19:46.456468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13363): Terminated: ok {rc=0} 11:19:46.542810 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 smpp esme_ms_sms_transaction.py ---------------------------------------------- 11:19:47.630460 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:47.641348 tst smpp: Using 1 x bts (candidates: 1) 11:19:47.676599 tst esme_ms_sms_transaction.py: using LAC 33587 11:19:47.802090 tst esme_ms_sms_transaction.py: using RAC 182 11:19:47.926542 tst esme_ms_sms_transaction.py: using CellId 33587 11:19:48.047939 tst esme_ms_sms_transaction.py: using BVCI 33588 11:19:48.158048 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:48.168453 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:48.178835 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:48.189150 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:48.199374 tst smpp: Using 1 x ip_address (candidates: 6) 11:19:48.209967 tst smpp: Using 1 x modem (candidates: 1) 11:19:48.339730 tst esme_ms_sms_transaction.py: using MSISDN 8132 11:19:48.449444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:19:48.912599 run create_hlr_db(pid=13366): Launched 11:19:49.035072 bus /sierra_2: Setting Powered False 11:19:50.094885 run create_hlr_db(pid=13366): Terminated: ok {rc=0} 11:19:50.535546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13368): Launched 11:19:50.857673 run osmo-hlr_10.42.42.2(pid=13369): Launched 11:19:50.981416 run osmo-stp_10.42.42.5: Starting osmo-stp 11:19:51.535938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13371): Launched 11:19:51.857161 run osmo-stp_10.42.42.5(pid=13372): Launched 11:19:51.980882 run osmo-msc_10.42.42.6: Starting osmo-msc 11:19:52.562135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13374): Launched 11:19:52.883211 run osmo-msc_10.42.42.6(pid=13375): Launched 11:19:53.063265 run osmo-stp_10.42.42.5(pid=13372): ERR: Terminated: ERROR {rc=1} [trial-2388↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13372)] 11:19:53.199738 run osmo-stp_10.42.42.5(pid=13372): stdout: | (launched: 2022-12-13_11:19:51.798673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:53.336853 run osmo-stp_10.42.42.5(pid=13372): stderr: | 20221213111951990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111951990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111951991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111951991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111951992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111951992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111951992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:53.472556 run osmo-stp_10.42.42.5(pid=13372): stdout: | (launched: 2022-12-13_11:19:51.798673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:19:53.601203 run osmo-stp_10.42.42.5(pid=13372): stderr: | 20221213111951990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213111951990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213111951991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213111951991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213111951992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213111951992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213111951992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:19:53.754987 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=13372): Process ended prematurely: osmo-stp_10.42.42.5(pid=13372) [trial-2388↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13372)] [trial-2388↪smpp↪esme_ms_sms_transaction.py:28] 11:19:53.763737 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec) 11:19:53.790772 run osmo-hlr_10.42.42.2(pid=13369): ERR: Terminated: ERROR {rc=237} [trial-2388↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13369)] 11:19:53.841201 run osmo-hlr_10.42.42.2(pid=13369): stdout: | (launched: 2022-12-13_11:19:50.799199) 11:19:53.893111 run osmo-hlr_10.42.42.2(pid=13369): stderr: | 20221213111950997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111950997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111950997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111950997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111950997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111950997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111951015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111951024 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111951025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111951025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:19:53.965945 run osmo-msc_10.42.42.6(pid=13375): ERR: Terminated: ERROR {rc=2} [trial-2388↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13375)] 11:19:54.015933 run osmo-msc_10.42.42.6(pid=13375): stdout: | (launched: 2022-12-13_11:19:52.824424) 11:19:54.067872 run osmo-msc_10.42.42.6(pid=13375): stderr: | 20221213111953145 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213111953145 DLGLOBAL DEBUG validating counter group 0x7fd79b9efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213111953145 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213111953145 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213111953145 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213111953146 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213111953147 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213111953148 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213111953148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213111953148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:19:54.120456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13368): Terminating (SIGTERM) 11:19:54.162517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13371): Terminating (SIGTERM) 11:19:54.204554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13374): Terminating (SIGTERM) 11:19:54.247147 --- ParallelTerminationStrategy: PID 13368 died... 11:19:54.267937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13368): Terminated: ok {rc=0} 11:19:54.314104 --- ParallelTerminationStrategy: PID 13371 died... 11:19:54.333759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13371): Terminated: ok {rc=0} 11:19:54.379803 --- ParallelTerminationStrategy: PID 13374 died... 11:19:54.399551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13374): Terminated: ok {rc=0} 11:19:54.487968 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 encryption --------------------------------------------------------------------- 11:19:55.676647 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:19:55.679929 tst encryption: Verifying 1 x bts (candidates: 11) 11:19:55.701378 tst encryption: Verifying 6 x ip_address (candidates: 9) 11:19:55.728162 tst encryption: Verifying 1 x modem (candidates: 12) 11:19:55.762860 tst encryption: Reserving 1 x bts (candidates: 11) 11:19:55.783276 tst encryption: Reserving 6 x ip_address (candidates: 9) 11:19:55.809270 tst encryption: Reserving 1 x modem (candidates: 12) 11:19:56.341150 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2388 encryption register_a5_0_authopt.py ---------------------------------------------- 11:19:56.393642 tst encryption: Using 1 x ip_address (candidates: 6) 11:19:56.404022 tst encryption: Using 1 x bts (candidates: 1) 11:19:56.436686 tst register_a5_0_authopt.py: using LAC 33588 11:19:56.566204 tst register_a5_0_authopt.py: using RAC 183 11:19:56.692016 tst register_a5_0_authopt.py: using CellId 33588 11:19:56.817806 tst register_a5_0_authopt.py: using BVCI 33589 11:19:56.929324 tst encryption: Using 1 x ip_address (candidates: 6) 11:19:56.939640 tst encryption: Using 1 x ip_address (candidates: 6) 11:19:56.949941 tst encryption: Using 1 x ip_address (candidates: 6) 11:19:56.960034 tst encryption: Using 1 x ip_address (candidates: 6) 11:19:56.970314 tst encryption: Using 1 x ip_address (candidates: 6) 11:19:56.980423 tst encryption: Using 1 x modem (candidates: 1) 11:19:57.098738 tst register_a5_0_authopt.py:8: start network... 11:19:57.319103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:19:57.823606 run create_hlr_db(pid=13380): Launched 11:19:57.947413 bus /sierra_2: Setting Powered False 11:19:59.011688 run create_hlr_db(pid=13380): Terminated: ok {rc=0} 11:19:59.447203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13382): Launched 11:19:59.751158 run osmo-hlr_10.42.42.2(pid=13383): Launched 11:19:59.866896 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:00.388786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13385): Launched 11:20:00.692294 run osmo-stp_10.42.42.5(pid=13386): Launched 11:20:00.807613 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:01.430826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13388): Launched 11:20:01.747789 run osmo-msc_10.42.42.6(pid=13389): Launched 11:20:02.018146 run osmo-stp_10.42.42.5(pid=13386): ERR: Terminated: ERROR {rc=1} [trial-2388↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13386)] 11:20:02.171269 run osmo-stp_10.42.42.5(pid=13386): stdout: | (launched: 2022-12-13_11:20:00.636464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:02.318558 run osmo-stp_10.42.42.5(pid=13386): stderr: | 20221213112000810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112000810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112000810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112000811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112000811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112000811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112000811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:02.496331 run osmo-stp_10.42.42.5(pid=13386): stdout: | (launched: 2022-12-13_11:20:00.636464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:02.619798 run osmo-stp_10.42.42.5(pid=13386): stderr: | 20221213112000810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112000810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112000810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112000811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112000811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112000811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112000811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:02.765194 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13386): Process ended prematurely: osmo-stp_10.42.42.5(pid=13386) [trial-2388↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13386)] [trial-2388↪encryption↪register_a5_0_authopt.py:8] 11:20:02.774224 tst register_a5_0_authopt.py:8: Test FAILED (6.4 sec) 11:20:02.800374 run osmo-hlr_10.42.42.2(pid=13383): ERR: Terminated: ERROR {rc=237} [trial-2388↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13383)] 11:20:02.848767 run osmo-hlr_10.42.42.2(pid=13383): stdout: | (launched: 2022-12-13_11:19:59.695331) 11:20:02.898411 run osmo-hlr_10.42.42.2(pid=13383): stderr: | 20221213111959875 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213111959875 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213111959876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213111959876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213111959876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213111959876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213111959888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213111959899 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213111959899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213111959899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:02.967758 run osmo-msc_10.42.42.6(pid=13389): ERR: Terminated: ERROR {rc=2} [trial-2388↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13389)] 11:20:03.015717 run osmo-msc_10.42.42.6(pid=13389): stdout: | (launched: 2022-12-13_11:20:01.685212) 11:20:03.065473 run osmo-msc_10.42.42.6(pid=13389): stderr: | 20221213112002316 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112002316 DLGLOBAL DEBUG validating counter group 0x7fea534c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112002317 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112002317 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112002317 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112002318 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112002326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112002326 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112002326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112002327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:03.115489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13382): Terminating (SIGTERM) 11:20:03.155554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13385): Terminating (SIGTERM) 11:20:03.195800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13388): Terminating (SIGTERM) 11:20:03.236156 --- ParallelTerminationStrategy: PID 13382 died... 11:20:03.255651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13382): Terminated: ok {rc=0} 11:20:03.300111 --- ParallelTerminationStrategy: PID 13385 died... 11:20:03.318939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13385): Terminated: ok {rc=0} 11:20:03.363238 --- ParallelTerminationStrategy: PID 13388 died... 11:20:03.382114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13388): Terminated: ok {rc=0} 11:20:03.468274 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 encryption register_a5_0_authreq.py ---------------------------------------------- 11:20:04.621164 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:04.632476 tst encryption: Using 1 x bts (candidates: 1) 11:20:04.669847 tst register_a5_0_authreq.py: using LAC 33589 11:20:04.797179 tst register_a5_0_authreq.py: using RAC 184 11:20:04.929148 tst register_a5_0_authreq.py: using CellId 33589 11:20:05.056894 tst register_a5_0_authreq.py: using BVCI 33590 11:20:05.175275 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:05.186197 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:05.196870 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:05.207576 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:05.218567 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:05.229592 tst encryption: Using 1 x modem (candidates: 1) 11:20:05.352420 tst register_a5_0_authreq.py:8: start network... 11:20:05.572896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:06.076873 run create_hlr_db(pid=13395): Launched 11:20:06.201831 bus /sierra_2: Setting Powered False 11:20:07.266133 run create_hlr_db(pid=13395): Terminated: ok {rc=0} 11:20:07.700516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13397): Launched 11:20:08.004646 run osmo-hlr_10.42.42.2(pid=13398): Launched 11:20:08.120166 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:08.642595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13400): Launched 11:20:08.946150 run osmo-stp_10.42.42.5(pid=13401): Launched 11:20:09.060911 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:09.607480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13403): Launched 11:20:09.913148 run osmo-msc_10.42.42.6(pid=13404): Launched 11:20:10.082865 run osmo-stp_10.42.42.5(pid=13401): ERR: Terminated: ERROR {rc=1} [trial-2388↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13401)] 11:20:10.211242 run osmo-stp_10.42.42.5(pid=13401): stdout: | (launched: 2022-12-13_11:20:08.890225) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:10.339806 run osmo-stp_10.42.42.5(pid=13401): stderr: | 20221213112009059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112009059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112009060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112009060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112009061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112009061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112009061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:10.465986 run osmo-stp_10.42.42.5(pid=13401): stdout: | (launched: 2022-12-13_11:20:08.890225) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:10.586894 run osmo-stp_10.42.42.5(pid=13401): stderr: | 20221213112009059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112009059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112009060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112009060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112009061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112009061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112009061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:10.731358 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13401): Process ended prematurely: osmo-stp_10.42.42.5(pid=13401) [trial-2388↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13401)] [trial-2388↪encryption↪register_a5_0_authreq.py:8] 11:20:10.740149 tst register_a5_0_authreq.py:8: Test FAILED (6.2 sec) 11:20:10.766149 run osmo-hlr_10.42.42.2(pid=13398): ERR: Terminated: ERROR {rc=237} [trial-2388↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13398)] 11:20:10.813244 run osmo-hlr_10.42.42.2(pid=13398): stdout: | (launched: 2022-12-13_11:20:07.949078) 11:20:10.861757 run osmo-hlr_10.42.42.2(pid=13398): stderr: | 20221213112008127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112008127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112008127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112008127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112008127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112008127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112008141 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112008151 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112008151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112008152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:10.929648 run osmo-msc_10.42.42.6(pid=13404): ERR: Terminated: ERROR {rc=2} [trial-2388↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13404)] 11:20:10.976807 run osmo-msc_10.42.42.6(pid=13404): stdout: | (launched: 2022-12-13_11:20:09.857150) 11:20:11.025719 run osmo-msc_10.42.42.6(pid=13404): stderr: | 20221213112010131 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112010132 DLGLOBAL DEBUG validating counter group 0x7fbeb3d27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112010132 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112010132 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112010132 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112010133 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112010134 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112010135 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112010135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112010135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:11.074806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13397): Terminating (SIGTERM) 11:20:11.114385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13400): Terminating (SIGTERM) 11:20:11.154226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13403): Terminating (SIGTERM) 11:20:11.193964 --- ParallelTerminationStrategy: PID 13397 died... 11:20:11.213208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13397): Terminated: ok {rc=0} 11:20:11.257170 --- ParallelTerminationStrategy: PID 13400 died... 11:20:11.275823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13400): Terminated: ok {rc=0} 11:20:11.319507 --- ParallelTerminationStrategy: PID 13403 died... 11:20:11.338250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13403): Terminated: ok {rc=0} 11:20:11.423465 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 encryption register_a5_1_authreq.py ---------------------------------------------- 11:20:12.570389 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:12.581405 tst encryption: Using 1 x bts (candidates: 1) 11:20:12.617103 tst register_a5_1_authreq.py: using LAC 33590 11:20:12.751657 tst register_a5_1_authreq.py: using RAC 185 11:20:12.878317 tst register_a5_1_authreq.py: using CellId 33590 11:20:12.996721 tst register_a5_1_authreq.py: using BVCI 33591 11:20:13.107532 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:13.117962 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:13.128260 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:13.138494 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:13.148537 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:13.158711 tst encryption: Using 1 x modem (candidates: 1) 11:20:13.272799 tst register_a5_1_authreq.py:8: start network... 11:20:13.478144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:13.949273 run create_hlr_db(pid=13406): Launched 11:20:14.073220 bus /sierra_2: Setting Powered False 11:20:15.134456 run create_hlr_db(pid=13406): Terminated: ok {rc=0} 11:20:15.557157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13408): Launched 11:20:15.867617 run osmo-hlr_10.42.42.2(pid=13409): Launched 11:20:16.039867 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:16.724089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13411): Launched 11:20:17.063764 run osmo-stp_10.42.42.5(pid=13412): Launched 11:20:17.336654 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:17.946837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13414): Launched 11:20:18.272158 run osmo-msc_10.42.42.6(pid=13415): Launched 11:20:18.454073 run osmo-stp_10.42.42.5(pid=13412): ERR: Terminated: ERROR {rc=1} [trial-2388↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13412)] 11:20:18.592298 run osmo-stp_10.42.42.5(pid=13412): stdout: | (launched: 2022-12-13_11:20:16.999692) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:18.729735 run osmo-stp_10.42.42.5(pid=13412): stderr: | 20221213112017203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112017204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112017204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112017204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112017205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112017205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112017205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:18.866268 run osmo-stp_10.42.42.5(pid=13412): stdout: | (launched: 2022-12-13_11:20:16.999692) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:18.996560 run osmo-stp_10.42.42.5(pid=13412): stderr: | 20221213112017203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112017204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112017204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112017204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112017205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112017205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112017205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:19.152696 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13412): Process ended prematurely: osmo-stp_10.42.42.5(pid=13412) [trial-2388↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13412)] [trial-2388↪encryption↪register_a5_1_authreq.py:8] 11:20:19.162346 tst register_a5_1_authreq.py:8: Test FAILED (6.6 sec) 11:20:19.189807 run osmo-hlr_10.42.42.2(pid=13409): ERR: Terminated: ERROR {rc=237} [trial-2388↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13409)] 11:20:19.240182 run osmo-hlr_10.42.42.2(pid=13409): stdout: | (launched: 2022-12-13_11:20:15.804635) 11:20:19.291887 run osmo-hlr_10.42.42.2(pid=13409): stderr: | 20221213112016161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112016161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112016161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112016161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112016161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112016161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112016179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112016196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112016196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112016196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:19.364329 run osmo-msc_10.42.42.6(pid=13415): ERR: Terminated: ERROR {rc=2} [trial-2388↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13415)] 11:20:19.413687 run osmo-msc_10.42.42.6(pid=13415): stdout: | (launched: 2022-12-13_11:20:18.212924) 11:20:19.465293 run osmo-msc_10.42.42.6(pid=13415): stderr: | 20221213112018538 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112018538 DLGLOBAL DEBUG validating counter group 0x7f372b832c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112018538 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112018538 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112018538 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112018538 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112018540 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112018540 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112018541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112018541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:19.517293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13408): Terminating (SIGTERM) 11:20:19.559036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13411): Terminating (SIGTERM) 11:20:19.600895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13414): Terminating (SIGTERM) 11:20:19.643290 --- ParallelTerminationStrategy: PID 13408 died... 11:20:19.663711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13408): Terminated: ok {rc=0} 11:20:19.710024 --- ParallelTerminationStrategy: PID 13411 died... 11:20:19.729898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13411): Terminated: ok {rc=0} 11:20:19.775790 --- ParallelTerminationStrategy: PID 13414 died... 11:20:19.795628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13414): Terminated: ok {rc=0} 11:20:19.883222 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2388 encryption register_a5_3_authreq.py ---------------------------------------------- 11:20:21.033777 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:21.045326 tst encryption: Using 1 x bts (candidates: 1) 11:20:21.082027 tst register_a5_3_authreq.py: using LAC 33591 11:20:21.202510 tst register_a5_3_authreq.py: using RAC 186 11:20:21.322874 tst register_a5_3_authreq.py: using CellId 33591 11:20:21.443975 tst register_a5_3_authreq.py: using BVCI 33592 11:20:21.555500 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:21.566056 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:21.576240 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:21.586499 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:21.596586 tst encryption: Using 1 x ip_address (candidates: 6) 11:20:21.606751 tst encryption: Using 1 x modem (candidates: 1) 11:20:21.731666 tst register_a5_3_authreq.py:8: start network... 11:20:21.936499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:22.405298 run create_hlr_db(pid=13417): Launched 11:20:22.528754 bus /sierra_2: Setting Powered False 11:20:23.589416 run create_hlr_db(pid=13417): Terminated: ok {rc=0} 11:20:24.032624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13419): Launched 11:20:24.357690 run osmo-hlr_10.42.42.2(pid=13420): Launched 11:20:24.482086 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:25.039443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13422): Launched 11:20:25.365697 run osmo-stp_10.42.42.5(pid=13423): Launched 11:20:25.490050 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:26.076358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13425): Launched 11:20:26.402622 run osmo-msc_10.42.42.6(pid=13426): Launched 11:20:26.584841 run osmo-stp_10.42.42.5(pid=13423): ERR: Terminated: ERROR {rc=1} [trial-2388↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13423)] 11:20:26.722801 run osmo-stp_10.42.42.5(pid=13423): stdout: | (launched: 2022-12-13_11:20:25.306594) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:26.860914 run osmo-stp_10.42.42.5(pid=13423): stderr: | 20221213112025498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112025498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112025499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112025499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112025499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112025500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112025500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:26.998503 run osmo-stp_10.42.42.5(pid=13423): stdout: | (launched: 2022-12-13_11:20:25.306594) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:27.129412 run osmo-stp_10.42.42.5(pid=13423): stderr: | 20221213112025498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112025498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112025499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112025499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112025499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112025500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112025500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:27.285413 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13423): Process ended prematurely: osmo-stp_10.42.42.5(pid=13423) [trial-2388↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13423)] [trial-2388↪encryption↪register_a5_3_authreq.py:8] 11:20:27.295134 tst register_a5_3_authreq.py:8: Test FAILED (6.3 sec) 11:20:27.322577 run osmo-hlr_10.42.42.2(pid=13420): ERR: Terminated: ERROR {rc=237} [trial-2388↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13420)] 11:20:27.373229 run osmo-hlr_10.42.42.2(pid=13420): stdout: | (launched: 2022-12-13_11:20:24.298761) 11:20:27.425325 run osmo-hlr_10.42.42.2(pid=13420): stderr: | 20221213112024496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112024496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112024496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112024496 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112024496 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112024496 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112024508 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112024517 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112024517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112024517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:27.497658 run osmo-msc_10.42.42.6(pid=13426): ERR: Terminated: ERROR {rc=2} [trial-2388↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13426)] 11:20:27.547258 run osmo-msc_10.42.42.6(pid=13426): stdout: | (launched: 2022-12-13_11:20:26.343580) 11:20:27.599666 run osmo-msc_10.42.42.6(pid=13426): stderr: | 20221213112026664 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112026664 DLGLOBAL DEBUG validating counter group 0x7f25bdf85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112026664 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112026664 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112026664 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112026665 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112026666 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112026667 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112026667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112026667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:27.651751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13419): Terminating (SIGTERM) 11:20:27.694090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13422): Terminating (SIGTERM) 11:20:27.736173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13425): Terminating (SIGTERM) 11:20:27.778827 --- ParallelTerminationStrategy: PID 13419 died... 11:20:27.799215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13419): Terminated: ok {rc=0} 11:20:27.845396 --- ParallelTerminationStrategy: PID 13422 died... 11:20:27.865243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13422): Terminated: ok {rc=0} 11:20:27.911357 --- ParallelTerminationStrategy: PID 13425 died... 11:20:27.931150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13425): Terminated: ok {rc=0} 11:20:28.018355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 11:20:29.229531 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:20:29.234817 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 11:20:29.253206 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 11:20:29.282080 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 11:20:29.310221 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 11:20:29.329527 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 11:20:29.357001 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 11:20:29.865626 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2388 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 11:20:29.870883 tst handover.py:11: TEST_CONFIG: {} 11:20:30.072092 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:20:30.087638 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:20:30.110153 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:20:30.158821 tst handover.py: using MSISDN 8133 11:20:30.278491 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8133', subscriber_id=0} 11:20:30.392633 run srsepc_10.42.42.118: Starting srsepc 11:20:32.307078 run rm-remote-dir(pid=13431): Launched 11:20:32.435435 bus /sierra_2: Setting Powered False 11:20:33.503094 run rm-remote-dir(pid=13431): Terminated: ok {rc=0} 11:20:33.949310 run mk-remote-dir(pid=13432): Launched 11:20:35.127545 run mk-remote-dir(pid=13432): Terminated: ok {rc=0} 11:20:35.415449 run scp-inst-to-remote(pid=13433): Launched 11:20:37.592003 run scp-inst-to-remote(pid=13433): Terminated: ok {rc=0} 11:20:37.920821 run rm-remote-dir(pid=13435): Launched 11:20:39.098425 run rm-remote-dir(pid=13435): Terminated: ok {rc=0} 11:20:39.428922 run mk-remote-dir(pid=13436): Launched 11:20:40.606283 run mk-remote-dir(pid=13436): Terminated: ok {rc=0} 11:20:40.887567 run scp-cfg-to-remote(pid=13437): Launched 11:20:42.062274 run scp-cfg-to-remote(pid=13437): Terminated: ok {rc=0} 11:20:42.342359 run scp-db-to-remote(pid=13439): Launched 11:20:43.517191 run scp-db-to-remote(pid=13439): Terminated: ok {rc=0} 11:20:43.646651 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:20:43.949261 run patchelf(pid=13441): Launched 11:20:45.124529 run patchelf(pid=13441): Terminated: ok {rc=0} 11:20:45.253083 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:20:45.556079 run setcap-netadm(pid=13442): Launched 11:20:46.750303 run setcap-netadm(pid=13442): Terminated: ok {rc=0} 11:20:47.131408 run srsepc(pid=13443): Launched 11:20:47.297649 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:20:48.389464 run rm-remote-dir(pid=13444): Launched 11:20:48.564366 run srsepc(pid=13443): ERR: Terminated: ERROR {rc=127} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13443)] 11:20:48.697840 run srsepc(pid=13443): stdout: | (launched: 2022-12-13_11:20:47.065803) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:20:48.830877 run srsepc(pid=13443): stderr: | (launched: 2022-12-13_11:20:47.115400) | Connection to 10.42.42.116 closed. 11:20:48.963099 run srsepc(pid=13443): stdout: | (launched: 2022-12-13_11:20:47.065803) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:20:49.090275 run srsepc(pid=13443): stderr: | (launched: 2022-12-13_11:20:47.115400) | Connection to 10.42.42.116 closed. 11:20:49.240597 run rm-remote-dir(pid=13444): Terminating (SIGINT) 11:20:49.416673 run rm-remote-dir(pid=13444): Terminated: ok {rc=0} 11:20:49.543416 tst handover.py:37: ERR: Error: srsepc(pid=13443): Process ended prematurely: srsepc(pid=13443) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13443)] [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 11:20:49.553214 tst handover.py:37: Test FAILED (19.7 sec) 11:20:49.629345 run scp-back-log(pid=13445): Launched 11:20:50.705737 run scp-back-log(pid=13445): ERR: Terminated: ERROR {rc=1} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13445)] 11:20:50.765938 run scp-back-log(pid=13445): stdout: | (launched: 2022-12-13_11:20:49.599060) 11:20:50.827493 run scp-back-log(pid=13445): stderr: | (launched: 2022-12-13_11:20:49.618584) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:20:50.896710 tst srsepc_10.42.42.118: Error('scp-back-log(pid=13445): launch_sync(): local process exited with status 1 [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13445)]') ---------------------------------------------- trial-2388 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 11:20:50.940883 tst iperf3_bidir.py:13: Number of physical ue: 1 11:20:51.141533 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:20:51.182965 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 11:20:51.382356 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:20:51.397787 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:20:51.429176 tst iperf3_bidir.py: using MSISDN 8134 11:20:51.539736 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8134', subscriber_id=0} 11:20:51.644507 run srsepc_10.42.42.118: Starting srsepc 11:20:52.277600 run rm-remote-dir(pid=13448): Launched 11:20:53.455411 run rm-remote-dir(pid=13448): Terminated: ok {rc=0} 11:20:53.787234 run mk-remote-dir(pid=13449): Launched 11:20:54.965984 run mk-remote-dir(pid=13449): Terminated: ok {rc=0} 11:20:55.248017 run scp-inst-to-remote(pid=13450): Launched 11:20:57.429250 run scp-inst-to-remote(pid=13450): Terminated: ok {rc=0} 11:20:57.782124 run rm-remote-dir(pid=13452): Launched 11:20:58.970545 run rm-remote-dir(pid=13452): Terminated: ok {rc=0} 11:20:59.325954 run mk-remote-dir(pid=13453): Launched 11:21:00.515755 run mk-remote-dir(pid=13453): Terminated: ok {rc=0} 11:21:00.818536 run scp-cfg-to-remote(pid=13454): Launched 11:21:02.068330 run scp-cfg-to-remote(pid=13454): Terminated: ok {rc=0} 11:21:02.389065 run scp-db-to-remote(pid=13456): Launched 11:21:03.576296 run scp-db-to-remote(pid=13456): Terminated: ok {rc=0} 11:21:03.715507 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:21:04.041692 run patchelf(pid=13458): Launched 11:21:05.228033 run patchelf(pid=13458): Terminated: ok {rc=0} 11:21:05.367301 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:21:05.693356 run setcap-netadm(pid=13459): Launched 11:21:06.879115 run setcap-netadm(pid=13459): Terminated: ok {rc=0} 11:21:07.221543 run srsepc(pid=13460): Launched 11:21:07.341712 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:21:08.511507 run rm-remote-dir(pid=13461): Launched 11:21:08.697212 run srsepc(pid=13460): ERR: Terminated: ERROR {rc=127} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13460)] 11:21:08.839928 run srsepc(pid=13460): stdout: | (launched: 2022-12-13_11:21:07.162220) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:21:08.982982 run srsepc(pid=13460): stderr: | (launched: 2022-12-13_11:21:07.210640) | Connection to 10.42.42.116 closed. 11:21:09.126273 run srsepc(pid=13460): stdout: | (launched: 2022-12-13_11:21:07.162220) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:21:09.263519 run srsepc(pid=13460): stderr: | (launched: 2022-12-13_11:21:07.210640) | Connection to 10.42.42.116 closed. 11:21:09.426533 run rm-remote-dir(pid=13461): Terminating (SIGINT) 11:21:09.614580 run rm-remote-dir(pid=13461): Terminated: ok {rc=0} 11:21:09.750881 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=13460): Process ended prematurely: srsepc(pid=13460) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13460)] [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 11:21:09.761466 tst iperf3_bidir.py:42: Test FAILED (18.8 sec) 11:21:09.842107 run scp-back-log(pid=13462): Launched 11:21:10.920900 run scp-back-log(pid=13462): ERR: Terminated: ERROR {rc=1} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13462)] 11:21:10.985413 run scp-back-log(pid=13462): stdout: | (launched: 2022-12-13_11:21:09.810338) 11:21:11.050845 run scp-back-log(pid=13462): stderr: | (launched: 2022-12-13_11:21:09.830955) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:21:11.124866 tst srsepc_10.42.42.118: Error('scp-back-log(pid=13462): launch_sync(): local process exited with status 1 [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13462)]') ---------------------------------------------- trial-2388 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 11:21:11.172038 tst iperf3_dl.py:13: Number of physical ue: 1 11:21:11.390960 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:21:11.435674 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 11:21:11.652535 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:21:11.668771 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:21:11.701687 tst iperf3_dl.py: using MSISDN 8135 11:21:11.821572 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8135', subscriber_id=0} 11:21:11.935898 run srsepc_10.42.42.118: Starting srsepc 11:21:12.602360 run rm-remote-dir(pid=13464): Launched 11:21:13.790957 run rm-remote-dir(pid=13464): Terminated: ok {rc=0} 11:21:14.146056 run mk-remote-dir(pid=13465): Launched 11:21:15.331190 run mk-remote-dir(pid=13465): Terminated: ok {rc=0} 11:21:15.613942 run scp-inst-to-remote(pid=13466): Launched 11:21:17.794285 run scp-inst-to-remote(pid=13466): Terminated: ok {rc=0} 11:21:18.146999 run rm-remote-dir(pid=13468): Launched 11:21:19.334884 run rm-remote-dir(pid=13468): Terminated: ok {rc=0} 11:21:19.689643 run mk-remote-dir(pid=13469): Launched 11:21:20.878145 run mk-remote-dir(pid=13469): Terminated: ok {rc=0} 11:21:21.180022 run scp-cfg-to-remote(pid=13470): Launched 11:21:22.365179 run scp-cfg-to-remote(pid=13470): Terminated: ok {rc=0} 11:21:22.665437 run scp-db-to-remote(pid=13472): Launched 11:21:23.854247 run scp-db-to-remote(pid=13472): Terminated: ok {rc=0} 11:21:23.993311 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:21:24.320468 run patchelf(pid=13474): Launched 11:21:25.506808 run patchelf(pid=13474): Terminated: ok {rc=0} 11:21:25.646444 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:21:25.973117 run setcap-netadm(pid=13475): Launched 11:21:27.158957 run setcap-netadm(pid=13475): Terminated: ok {rc=0} 11:21:27.501473 run srsepc(pid=13476): Launched 11:21:27.621988 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:21:28.729859 run rm-remote-dir(pid=13477): Launched 11:21:28.906398 run srsepc(pid=13476): ERR: Terminated: ERROR {rc=127} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13476)] 11:21:29.041197 run srsepc(pid=13476): stdout: | (launched: 2022-12-13_11:21:27.442154) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:21:29.174882 run srsepc(pid=13476): stderr: | (launched: 2022-12-13_11:21:27.490627) | Connection to 10.42.42.116 closed. 11:21:29.307894 run srsepc(pid=13476): stdout: | (launched: 2022-12-13_11:21:27.442154) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:21:29.435890 run srsepc(pid=13476): stderr: | (launched: 2022-12-13_11:21:27.490627) | Connection to 10.42.42.116 closed. 11:21:29.586739 run rm-remote-dir(pid=13477): Terminating (SIGINT) 11:21:29.762882 run rm-remote-dir(pid=13477): Terminated: ok {rc=0} 11:21:29.890099 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=13476): Process ended prematurely: srsepc(pid=13476) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13476)] [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 11:21:29.899852 tst iperf3_dl.py:42: Test FAILED (18.7 sec) 11:21:29.976367 run scp-back-log(pid=13478): Launched 11:21:31.052858 run scp-back-log(pid=13478): ERR: Terminated: ERROR {rc=1} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13478)] 11:21:31.118887 run scp-back-log(pid=13478): stdout: | (launched: 2022-12-13_11:21:29.945855) 11:21:31.186471 run scp-back-log(pid=13478): stderr: | (launched: 2022-12-13_11:21:29.965557) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:21:31.262119 tst srsepc_10.42.42.118: Error('scp-back-log(pid=13478): launch_sync(): local process exited with status 1 [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13478)]') ---------------------------------------------- trial-2388 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 11:21:31.312083 tst iperf3_ul.py:13: Number of physical ue: 1 11:21:31.536390 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:21:31.579210 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 11:21:31.784605 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:21:31.800729 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:21:31.833355 tst iperf3_ul.py: using MSISDN 8136 11:21:31.946097 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8136', subscriber_id=0} 11:21:32.056293 run srsepc_10.42.42.118: Starting srsepc 11:21:32.726248 run rm-remote-dir(pid=13480): Launched 11:21:33.915711 run rm-remote-dir(pid=13480): Terminated: ok {rc=0} 11:21:34.272513 run mk-remote-dir(pid=13481): Launched 11:21:35.461555 run mk-remote-dir(pid=13481): Terminated: ok {rc=0} 11:21:35.765224 run scp-inst-to-remote(pid=13482): Launched 11:21:37.953150 run scp-inst-to-remote(pid=13482): Terminated: ok {rc=0} 11:21:38.307476 run rm-remote-dir(pid=13484): Launched 11:21:39.495181 run rm-remote-dir(pid=13484): Terminated: ok {rc=0} 11:21:39.851349 run mk-remote-dir(pid=13485): Launched 11:21:41.042097 run mk-remote-dir(pid=13485): Terminated: ok {rc=0} 11:21:41.345428 run scp-cfg-to-remote(pid=13486): Launched 11:21:42.530380 run scp-cfg-to-remote(pid=13486): Terminated: ok {rc=0} 11:21:42.834574 run scp-db-to-remote(pid=13488): Launched 11:21:44.020682 run scp-db-to-remote(pid=13488): Terminated: ok {rc=0} 11:21:44.160283 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:21:44.488326 run patchelf(pid=13490): Launched 11:21:45.676181 run patchelf(pid=13490): Terminated: ok {rc=0} 11:21:45.815628 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:21:46.213654 run setcap-netadm(pid=13491): Launched 11:21:47.424482 run setcap-netadm(pid=13491): Terminated: ok {rc=0} 11:21:47.745485 run srsepc(pid=13492): Launched 11:21:47.860026 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:21:48.958880 run rm-remote-dir(pid=13493): Launched 11:21:49.134518 run srsepc(pid=13492): ERR: Terminated: ERROR {rc=127} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13492)] 11:21:49.268702 run srsepc(pid=13492): stdout: | (launched: 2022-12-13_11:21:47.689537) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:21:49.402243 run srsepc(pid=13492): stderr: | (launched: 2022-12-13_11:21:47.734808) | Connection to 10.42.42.116 closed. 11:21:49.535261 run srsepc(pid=13492): stdout: | (launched: 2022-12-13_11:21:47.689537) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:21:49.663205 run srsepc(pid=13492): stderr: | (launched: 2022-12-13_11:21:47.734808) | Connection to 10.42.42.116 closed. 11:21:49.814880 run rm-remote-dir(pid=13493): Terminating (SIGINT) 11:21:49.990553 run rm-remote-dir(pid=13493): Terminated: ok {rc=0} 11:21:50.118008 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=13492): Process ended prematurely: srsepc(pid=13492) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13492)] [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 11:21:50.127892 tst iperf3_ul.py:42: Test FAILED (18.8 sec) 11:21:50.204207 run scp-back-log(pid=13494): Launched 11:21:51.280834 run scp-back-log(pid=13494): ERR: Terminated: ERROR {rc=1} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13494)] 11:21:51.341310 run scp-back-log(pid=13494): stdout: | (launched: 2022-12-13_11:21:50.173980) 11:21:51.403514 run scp-back-log(pid=13494): stderr: | (launched: 2022-12-13_11:21:50.193762) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:21:51.473810 tst srsepc_10.42.42.118: Error('scp-back-log(pid=13494): launch_sync(): local process exited with status 1 [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13494)]') ---------------------------------------------- trial-2388 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 11:21:51.519073 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:21:51.535435 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:21:51.557813 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:21:51.606394 tst ping.py: using MSISDN 8137 11:21:51.719669 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8137', subscriber_id=0} 11:21:51.825239 run srsepc_10.42.42.118: Starting srsepc 11:21:52.444218 run rm-remote-dir(pid=13497): Launched 11:21:53.622505 run rm-remote-dir(pid=13497): Terminated: ok {rc=0} 11:21:53.953609 run mk-remote-dir(pid=13498): Launched 11:21:55.130228 run mk-remote-dir(pid=13498): Terminated: ok {rc=0} 11:21:55.412843 run scp-inst-to-remote(pid=13499): Launched 11:21:57.593166 run scp-inst-to-remote(pid=13499): Terminated: ok {rc=0} 11:21:57.946803 run rm-remote-dir(pid=13501): Launched 11:21:59.135020 run rm-remote-dir(pid=13501): Terminated: ok {rc=0} 11:21:59.490060 run mk-remote-dir(pid=13502): Launched 11:22:00.677890 run mk-remote-dir(pid=13502): Terminated: ok {rc=0} 11:22:00.995832 run scp-cfg-to-remote(pid=13503): Launched 11:22:02.246614 run scp-cfg-to-remote(pid=13503): Terminated: ok {rc=0} 11:22:02.529602 run scp-db-to-remote(pid=13505): Launched 11:22:03.704642 run scp-db-to-remote(pid=13505): Terminated: ok {rc=0} 11:22:03.834483 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:22:04.138548 run patchelf(pid=13507): Launched 11:22:05.313557 run patchelf(pid=13507): Terminated: ok {rc=0} 11:22:05.442922 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:22:05.746930 run setcap-netadm(pid=13508): Launched 11:22:06.925433 run setcap-netadm(pid=13508): Terminated: ok {rc=0} 11:22:07.267825 run srsepc(pid=13509): Launched 11:22:07.388028 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:22:08.557516 run rm-remote-dir(pid=13510): Launched 11:22:08.742803 run srsepc(pid=13509): ERR: Terminated: ERROR {rc=127} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13509)] 11:22:08.885326 run srsepc(pid=13509): stdout: | (launched: 2022-12-13_11:22:07.208775) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:22:09.027956 run srsepc(pid=13509): stderr: | (launched: 2022-12-13_11:22:07.257055) | Connection to 10.42.42.116 closed. 11:22:09.170844 run srsepc(pid=13509): stdout: | (launched: 2022-12-13_11:22:07.208775) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:22:09.307813 run srsepc(pid=13509): stderr: | (launched: 2022-12-13_11:22:07.257055) | Connection to 10.42.42.116 closed. 11:22:09.470408 run rm-remote-dir(pid=13510): Terminating (SIGINT) 11:22:09.658879 run rm-remote-dir(pid=13510): Terminated: ok {rc=0} 11:22:09.794801 tst ping.py:16: ERR: Error: srsepc(pid=13509): Process ended prematurely: srsepc(pid=13509) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13509)] [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 11:22:09.805256 tst ping.py:16: Test FAILED (18.3 sec) 11:22:09.885568 run scp-back-log(pid=13511): Launched 11:22:10.965969 run scp-back-log(pid=13511): ERR: Terminated: ERROR {rc=1} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13511)] 11:22:11.030047 run scp-back-log(pid=13511): stdout: | (launched: 2022-12-13_11:22:09.854079) 11:22:11.095605 run scp-back-log(pid=13511): stderr: | (launched: 2022-12-13_11:22:09.874684) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:22:11.169491 tst srsepc_10.42.42.118: Error('scp-back-log(pid=13511): launch_sync(): local process exited with status 1 [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13511)]') ---------------------------------------------- trial-2388 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 11:22:11.217605 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:22:11.234431 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:22:11.258268 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:22:11.315385 tst rrc_idle_mo_ping.py: using MSISDN 8138 11:22:11.436478 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8138', subscriber_id=0} 11:22:11.550456 run srsepc_10.42.42.118: Starting srsepc 11:22:12.214552 run rm-remote-dir(pid=13513): Launched 11:22:13.402492 run rm-remote-dir(pid=13513): Terminated: ok {rc=0} 11:22:13.757278 run mk-remote-dir(pid=13514): Launched 11:22:14.944710 run mk-remote-dir(pid=13514): Terminated: ok {rc=0} 11:22:15.247555 run scp-inst-to-remote(pid=13515): Launched 11:22:17.430354 run scp-inst-to-remote(pid=13515): Terminated: ok {rc=0} 11:22:17.785811 run rm-remote-dir(pid=13517): Launched 11:22:18.984153 run rm-remote-dir(pid=13517): Terminated: ok {rc=0} 11:22:19.314792 run mk-remote-dir(pid=13518): Launched 11:22:20.491978 run mk-remote-dir(pid=13518): Terminated: ok {rc=0} 11:22:20.773696 run scp-cfg-to-remote(pid=13519): Launched 11:22:21.948353 run scp-cfg-to-remote(pid=13519): Terminated: ok {rc=0} 11:22:22.228566 run scp-db-to-remote(pid=13521): Launched 11:22:23.404335 run scp-db-to-remote(pid=13521): Terminated: ok {rc=0} 11:22:23.533539 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:22:23.836576 run patchelf(pid=13523): Launched 11:22:25.011987 run patchelf(pid=13523): Terminated: ok {rc=0} 11:22:25.141431 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:22:25.444462 run setcap-netadm(pid=13524): Launched 11:22:26.618555 run setcap-netadm(pid=13524): Terminated: ok {rc=0} 11:22:26.937643 run srsepc(pid=13525): Launched 11:22:27.050639 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:22:28.210277 run rm-remote-dir(pid=13526): Launched 11:22:28.395849 run srsepc(pid=13525): ERR: Terminated: ERROR {rc=127} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13525)] 11:22:28.538192 run srsepc(pid=13525): stdout: | (launched: 2022-12-13_11:22:26.881180) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:22:28.681503 run srsepc(pid=13525): stderr: | (launched: 2022-12-13_11:22:26.926605) | Connection to 10.42.42.116 closed. 11:22:28.824215 run srsepc(pid=13525): stdout: | (launched: 2022-12-13_11:22:26.881180) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:22:28.961732 run srsepc(pid=13525): stderr: | (launched: 2022-12-13_11:22:26.926605) | Connection to 10.42.42.116 closed. 11:22:29.124089 run rm-remote-dir(pid=13526): Terminating (SIGINT) 11:22:29.312820 run rm-remote-dir(pid=13526): Terminated: ok {rc=0} 11:22:29.449079 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=13525): Process ended prematurely: srsepc(pid=13525) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13525)] [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 11:22:29.459476 tst rrc_idle_mo_ping.py:16: Test FAILED (18.2 sec) 11:22:29.540131 run scp-back-log(pid=13527): Launched 11:22:30.620409 run scp-back-log(pid=13527): ERR: Terminated: ERROR {rc=1} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13527)] 11:22:30.684627 run scp-back-log(pid=13527): stdout: | (launched: 2022-12-13_11:22:29.508585) 11:22:30.750586 run scp-back-log(pid=13527): stderr: | (launched: 2022-12-13_11:22:29.529415) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:22:30.824711 tst srsepc_10.42.42.118: Error('scp-back-log(pid=13527): launch_sync(): local process exited with status 1 [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13527)]') ---------------------------------------------- trial-2388 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 11:22:30.877740 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:22:30.894858 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:22:30.925384 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:22:30.994200 tst rrc_idle_mt_ping.py: using MSISDN 8139 11:22:31.132506 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8139', subscriber_id=0} 11:22:31.252306 run srsepc_10.42.42.118: Starting srsepc 11:22:31.932470 run rm-remote-dir(pid=13529): Launched 11:22:33.175551 run rm-remote-dir(pid=13529): Terminated: ok {rc=0} 11:22:33.531546 run mk-remote-dir(pid=13530): Launched 11:22:34.719536 run mk-remote-dir(pid=13530): Terminated: ok {rc=0} 11:22:35.022625 run scp-inst-to-remote(pid=13531): Launched 11:22:37.206843 run scp-inst-to-remote(pid=13531): Terminated: ok {rc=0} 11:22:37.537962 run rm-remote-dir(pid=13533): Launched 11:22:38.714691 run rm-remote-dir(pid=13533): Terminated: ok {rc=0} 11:22:39.047415 run mk-remote-dir(pid=13534): Launched 11:22:40.225686 run mk-remote-dir(pid=13534): Terminated: ok {rc=0} 11:22:40.508567 run scp-cfg-to-remote(pid=13535): Launched 11:22:41.687118 run scp-cfg-to-remote(pid=13535): Terminated: ok {rc=0} 11:22:41.989442 run scp-db-to-remote(pid=13537): Launched 11:22:43.176285 run scp-db-to-remote(pid=13537): Terminated: ok {rc=0} 11:22:43.315912 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:22:43.643813 run patchelf(pid=13539): Launched 11:22:44.829959 run patchelf(pid=13539): Terminated: ok {rc=0} 11:22:44.969685 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:22:45.298555 run setcap-netadm(pid=13540): Launched 11:22:46.482842 run setcap-netadm(pid=13540): Terminated: ok {rc=0} 11:22:46.845688 run srsepc(pid=13541): Launched 11:22:47.004143 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:22:48.153829 run rm-remote-dir(pid=13542): Launched 11:22:48.329601 run srsepc(pid=13541): ERR: Terminated: ERROR {rc=127} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13541)] 11:22:48.464150 run srsepc(pid=13541): stdout: | (launched: 2022-12-13_11:22:46.774789) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:22:48.597415 run srsepc(pid=13541): stderr: | (launched: 2022-12-13_11:22:46.825519) | Connection to 10.42.42.116 closed. 11:22:48.730500 run srsepc(pid=13541): stdout: | (launched: 2022-12-13_11:22:46.774789) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:22:48.858184 run srsepc(pid=13541): stderr: | (launched: 2022-12-13_11:22:46.825519) | Connection to 10.42.42.116 closed. 11:22:49.008690 run rm-remote-dir(pid=13542): Terminating (SIGINT) 11:22:49.186067 run rm-remote-dir(pid=13542): Terminated: ok {rc=0} 11:22:49.313115 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=13541): Process ended prematurely: srsepc(pid=13541) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13541)] [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 11:22:49.322856 tst rrc_idle_mt_ping.py:16: Test FAILED (18.4 sec) 11:22:49.399473 run scp-back-log(pid=13543): Launched 11:22:50.477992 run scp-back-log(pid=13543): ERR: Terminated: ERROR {rc=1} [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13543)] 11:22:50.539327 run scp-back-log(pid=13543): stdout: | (launched: 2022-12-13_11:22:49.369297) 11:22:50.602020 run scp-back-log(pid=13543): stderr: | (launched: 2022-12-13_11:22:49.389085) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:22:50.672082 tst srsepc_10.42.42.118: Error('scp-back-log(pid=13543): launch_sync(): local process exited with status 1 [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=13543)]') --------------------------------------------------------------------- trial-2388 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 11:22:50.799267 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:22:50.804090 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 11:22:50.844509 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 11:22:50.870667 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 11:22:50.921128 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 11:22:50.962478 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 11:22:50.988669 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 11:22:51.541120 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 11:22:51.546188 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:22:51.556799 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 11:22:51.594737 tst handover.py: using LAC 33592 11:22:51.713414 tst handover.py: using RAC 187 11:22:51.832062 tst handover.py: using CellId 33592 11:22:51.959201 tst handover.py: using BVCI 33593 11:22:52.075966 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 11:22:52.110186 tst handover.py: using LAC 33593 11:22:52.238905 tst handover.py: using RAC 188 11:22:52.362132 tst handover.py: using CellId 33593 11:22:52.486129 tst handover.py: using BVCI 33594 11:22:52.604142 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:22:52.615475 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:22:52.626416 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:22:52.637620 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:22:52.649160 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:22:52.660553 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 11:22:52.777316 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 11:22:52.896580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:22:53.393023 run create_hlr_db(pid=13551): Launched 11:22:54.571283 run create_hlr_db(pid=13551): Terminated: ok {rc=0} 11:22:54.907701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13553): Launched 11:22:55.227311 run osmo-hlr_10.42.42.2(pid=13554): Launched 11:22:55.350602 run osmo-stp_10.42.42.5: Starting osmo-stp 11:22:55.897513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13556): Launched 11:22:56.216108 run osmo-stp_10.42.42.5(pid=13557): Launched 11:22:56.338458 run osmo-msc_10.42.42.6: Starting osmo-msc 11:22:56.915318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13559): Launched 11:22:57.236453 run osmo-msc_10.42.42.6(pid=13560): Launched 11:22:57.414762 run osmo-stp_10.42.42.5(pid=13557): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13557)] 11:22:57.550741 run osmo-stp_10.42.42.5(pid=13557): stdout: | (launched: 2022-12-13_11:22:56.157800) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:57.687061 run osmo-stp_10.42.42.5(pid=13557): stderr: | 20221213112256352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112256352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112256352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112256352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112256353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112256353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112256353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:57.822470 run osmo-stp_10.42.42.5(pid=13557): stdout: | (launched: 2022-12-13_11:22:56.157800) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:57.950281 run osmo-stp_10.42.42.5(pid=13557): stderr: | 20221213112256352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112256352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112256352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112256352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112256353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112256353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112256353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:58.103181 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=13557): Process ended prematurely: osmo-stp_10.42.42.5(pid=13557) [trial-2388↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13557)] [trial-2388↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 11:22:58.111897 tst handover.py:18: Test FAILED (6.6 sec) 11:22:58.138985 run osmo-hlr_10.42.42.2(pid=13554): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13554)] 11:22:58.190687 run osmo-hlr_10.42.42.2(pid=13554): stdout: | (launched: 2022-12-13_11:22:55.168812) 11:22:58.242915 run osmo-hlr_10.42.42.2(pid=13554): stderr: | 20221213112255366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112255366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112255366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112255366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112255366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112255366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112255378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112255386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112255386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112255386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:22:58.315249 run osmo-msc_10.42.42.6(pid=13560): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13560)] 11:22:58.365779 run osmo-msc_10.42.42.6(pid=13560): stdout: | (launched: 2022-12-13_11:22:57.178033) 11:22:58.417683 run osmo-msc_10.42.42.6(pid=13560): stderr: | 20221213112257497 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112257498 DLGLOBAL DEBUG validating counter group 0x7ffbc8114c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112257498 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112257498 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112257498 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112257498 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112257500 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112257500 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112257500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112257500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:22:58.469888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13553): Terminating (SIGTERM) 11:22:58.511491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13556): Terminating (SIGTERM) 11:22:58.553636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13559): Terminating (SIGTERM) 11:22:58.595838 --- ParallelTerminationStrategy: PID 13553 died... 11:22:58.616179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13553): Terminated: ok {rc=0} 11:22:58.662605 --- ParallelTerminationStrategy: PID 13556 died... 11:22:58.682387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13556): Terminated: ok {rc=0} 11:22:58.728561 --- ParallelTerminationStrategy: PID 13559 died... 11:22:58.748426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13559): Terminated: ok {rc=0} 11:22:58.836899 bus /sierra_3: Setting Powered False 11:22:59.935183 bus /sierra_3: Setting Powered False 11:23:01.051433 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 11:23:02.306929 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:23:02.312501 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 11:23:02.354100 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 11:23:02.381267 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 11:23:02.434967 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 11:23:02.473902 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 11:23:02.499704 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 11:23:03.051268 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 11:23:03.056287 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:23:03.067003 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 11:23:03.103087 tst handover.py: using LAC 33594 11:23:03.220700 tst handover.py: using RAC 189 11:23:03.338107 tst handover.py: using CellId 33594 11:23:03.459650 tst handover.py: using BVCI 33595 11:23:03.577555 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 11:23:03.611275 tst handover.py: using LAC 33595 11:23:03.735789 tst handover.py: using RAC 190 11:23:03.863798 tst handover.py: using CellId 33595 11:23:03.989309 tst handover.py: using BVCI 33596 11:23:04.106239 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:23:04.117452 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:23:04.128369 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:23:04.139350 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:23:04.151253 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:23:04.163164 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 11:23:04.283991 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 11:23:04.403608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:04.871588 run create_hlr_db(pid=13565): Launched 11:23:04.992504 bus /sierra_2: Setting Powered False 11:23:06.056076 run create_hlr_db(pid=13565): Terminated: ok {rc=0} 11:23:06.476150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13567): Launched 11:23:06.796001 run osmo-hlr_10.42.42.2(pid=13568): Launched 11:23:06.918648 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:07.444185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13570): Launched 11:23:07.764107 run osmo-stp_10.42.42.5(pid=13571): Launched 11:23:07.887017 run osmo-msc_10.42.42.6: Starting osmo-msc 11:23:08.440244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13573): Launched 11:23:08.761662 run osmo-msc_10.42.42.6(pid=13574): Launched 11:23:08.941346 run osmo-stp_10.42.42.5(pid=13571): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13571)] 11:23:09.076908 run osmo-stp_10.42.42.5(pid=13571): stdout: | (launched: 2022-12-13_11:23:07.705837) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:09.214249 run osmo-stp_10.42.42.5(pid=13571): stderr: | 20221213112307900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112307900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112307900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112307901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112307901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112307901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112307901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:09.349751 run osmo-stp_10.42.42.5(pid=13571): stdout: | (launched: 2022-12-13_11:23:07.705837) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:09.478890 run osmo-stp_10.42.42.5(pid=13571): stderr: | 20221213112307900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112307900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112307900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112307901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112307901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112307901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112307901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:09.632452 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=13571): Process ended prematurely: osmo-stp_10.42.42.5(pid=13571) [trial-2388↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13571)] [trial-2388↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 11:23:09.641402 tst handover.py:18: Test FAILED (6.6 sec) 11:23:09.668451 run osmo-hlr_10.42.42.2(pid=13568): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13568)] 11:23:09.718904 run osmo-hlr_10.42.42.2(pid=13568): stdout: | (launched: 2022-12-13_11:23:06.737868) 11:23:09.770707 run osmo-hlr_10.42.42.2(pid=13568): stderr: | 20221213112306937 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112306937 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112306937 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112306937 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112306937 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112306937 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112306949 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112306957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112306958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112306958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:09.843450 run osmo-msc_10.42.42.6(pid=13574): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13574)] 11:23:09.893114 run osmo-msc_10.42.42.6(pid=13574): stdout: | (launched: 2022-12-13_11:23:08.703153) 11:23:09.944747 run osmo-msc_10.42.42.6(pid=13574): stderr: | 20221213112309023 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112309024 DLGLOBAL DEBUG validating counter group 0x7efcb2fb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112309024 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112309024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112309024 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112309024 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112309026 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112309026 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112309026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112309026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:23:09.996597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13567): Terminating (SIGTERM) 11:23:10.038418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13570): Terminating (SIGTERM) 11:23:10.081008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13573): Terminating (SIGTERM) 11:23:10.123239 --- ParallelTerminationStrategy: PID 13567 died... 11:23:10.143460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13567): Terminated: ok {rc=0} 11:23:10.190056 --- ParallelTerminationStrategy: PID 13570 died... 11:23:10.209812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13570): Terminated: ok {rc=0} 11:23:10.256000 --- ParallelTerminationStrategy: PID 13573 died... 11:23:10.275755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13573): Terminated: ok {rc=0} 11:23:10.363863 bus /sierra_3: Setting Powered False 11:23:11.462255 bus /sierra_3: Setting Powered False 11:23:12.578020 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 11:23:13.824693 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:23:13.830264 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 11:23:13.885948 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 11:23:13.912811 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 11:23:13.965013 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 11:23:14.019653 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 11:23:14.046543 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 11:23:14.593916 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 11:23:14.598960 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:23:14.609727 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:23:14.646389 tst handover.py: using LAC 33596 11:23:14.764783 tst handover.py: using RAC 191 11:23:14.882856 tst handover.py: using CellId 33596 11:23:15.001750 tst handover.py: using BVCI 33597 11:23:15.110119 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:23:15.158862 tst handover.py: using LAC 33597 11:23:15.278417 tst handover.py: using RAC 192 11:23:15.405745 tst handover.py: using CellId 33597 11:23:15.534247 tst handover.py: using BVCI 33598 11:23:15.651277 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:23:15.662564 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:23:15.674063 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:23:15.685732 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:23:15.697717 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:23:15.709670 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:23:15.827185 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:23:15.971380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:16.541338 run create_hlr_db(pid=13579): Launched 11:23:16.696431 bus /sierra_2: Setting Powered False 11:23:17.759736 run create_hlr_db(pid=13579): Terminated: ok {rc=0} 11:23:18.162991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13581): Launched 11:23:18.460694 run osmo-hlr_10.42.42.2(pid=13582): Launched 11:23:18.575200 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:19.063526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13584): Launched 11:23:19.362465 run osmo-stp_10.42.42.5(pid=13585): Launched 11:23:19.475556 run osmo-msc_10.42.42.6: Starting osmo-msc 11:23:19.988933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13587): Launched 11:23:20.287271 run osmo-msc_10.42.42.6(pid=13588): Launched 11:23:20.453870 run osmo-stp_10.42.42.5(pid=13585): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13585)] 11:23:20.580758 run osmo-stp_10.42.42.5(pid=13585): stdout: | (launched: 2022-12-13_11:23:19.306912) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:20.707123 run osmo-stp_10.42.42.5(pid=13585): stderr: | 20221213112319475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112319476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112319476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112319476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112319477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112319477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112319477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:20.831370 run osmo-stp_10.42.42.5(pid=13585): stdout: | (launched: 2022-12-13_11:23:19.306912) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:20.950299 run osmo-stp_10.42.42.5(pid=13585): stderr: | 20221213112319475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112319476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112319476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112319476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112319477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112319477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112319477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:21.092462 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=13585): Process ended prematurely: osmo-stp_10.42.42.5(pid=13585) [trial-2388↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13585)] [trial-2388↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 11:23:21.100594 tst handover.py:18: Test FAILED (6.5 sec) 11:23:21.126062 run osmo-hlr_10.42.42.2(pid=13582): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13582)] 11:23:21.172865 run osmo-hlr_10.42.42.2(pid=13582): stdout: | (launched: 2022-12-13_11:23:18.406052) 11:23:21.221237 run osmo-hlr_10.42.42.2(pid=13582): stderr: | 20221213112318584 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112318584 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112318584 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112318584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112318585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112318585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112318597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112318605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112318606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112318606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:21.289258 run osmo-msc_10.42.42.6(pid=13588): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13588)] 11:23:21.336367 run osmo-msc_10.42.42.6(pid=13588): stdout: | (launched: 2022-12-13_11:23:20.232425) 11:23:21.385522 run osmo-msc_10.42.42.6(pid=13588): stderr: | 20221213112320501 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112320501 DLGLOBAL DEBUG validating counter group 0x7fd3d410cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112320501 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112320501 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112320501 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112320502 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112320503 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112320504 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112320504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112320504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:23:21.434394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13581): Terminating (SIGTERM) 11:23:21.473576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13584): Terminating (SIGTERM) 11:23:21.512750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13587): Terminating (SIGTERM) 11:23:21.552139 --- ParallelTerminationStrategy: PID 13581 died... 11:23:21.571047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13581): Terminated: ok {rc=0} 11:23:21.614402 --- ParallelTerminationStrategy: PID 13584 died... 11:23:21.632869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13584): Terminated: ok {rc=0} 11:23:21.676313 --- ParallelTerminationStrategy: PID 13587 died... 11:23:21.694650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13587): Terminated: ok {rc=0} 11:23:21.779427 bus /sierra_3: Setting Powered False 11:23:22.878391 bus /sierra_3: Setting Powered False 11:23:23.993324 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:23:25.247971 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:23:25.253352 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:23:25.301755 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:23:25.327648 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:23:25.381172 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:23:25.432247 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:23:25.459073 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:23:26.004215 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:23:26.009285 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:23:26.020100 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:23:26.056081 tst handover.py: using LAC 33598 11:23:26.182823 tst handover.py: using RAC 193 11:23:26.307478 tst handover.py: using CellId 33598 11:23:26.444579 tst handover.py: using BVCI 33599 11:23:26.563125 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:23:26.611980 tst handover.py: using LAC 33599 11:23:26.731352 tst handover.py: using RAC 194 11:23:26.850156 tst handover.py: using CellId 33599 11:23:26.968794 tst handover.py: using BVCI 33600 11:23:27.076092 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:23:27.087105 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:23:27.097862 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:23:27.108529 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:23:27.119298 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:23:27.130488 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:23:27.249381 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:23:27.366218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:27.803711 run create_hlr_db(pid=13593): Launched 11:23:27.925396 bus /sierra_2: Setting Powered False 11:23:28.984443 run create_hlr_db(pid=13593): Terminated: ok {rc=0} 11:23:29.394110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13595): Launched 11:23:29.713988 run osmo-hlr_10.42.42.2(pid=13596): Launched 11:23:29.835752 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:30.357686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13598): Launched 11:23:30.676439 run osmo-stp_10.42.42.5(pid=13599): Launched 11:23:30.798599 run osmo-msc_10.42.42.6: Starting osmo-msc 11:23:31.466107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13601): Launched 11:23:31.802572 run osmo-msc_10.42.42.6(pid=13602): Launched 11:23:32.182141 run osmo-stp_10.42.42.5(pid=13599): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13599)] 11:23:32.332211 run osmo-stp_10.42.42.5(pid=13599): stdout: | (launched: 2022-12-13_11:23:30.618230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:32.468795 run osmo-stp_10.42.42.5(pid=13599): stderr: | 20221213112330812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112330812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112330813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112330813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112330815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112330816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112330816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:32.602712 run osmo-stp_10.42.42.5(pid=13599): stdout: | (launched: 2022-12-13_11:23:30.618230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:32.730811 run osmo-stp_10.42.42.5(pid=13599): stderr: | 20221213112330812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112330812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112330813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112330813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112330815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112330816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112330816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:32.884127 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=13599): Process ended prematurely: osmo-stp_10.42.42.5(pid=13599) [trial-2388↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13599)] [trial-2388↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 11:23:32.893292 tst handover.py:18: Test FAILED (6.9 sec) 11:23:32.920400 run osmo-hlr_10.42.42.2(pid=13596): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13596)] 11:23:32.971128 run osmo-hlr_10.42.42.2(pid=13596): stdout: | (launched: 2022-12-13_11:23:29.655707) 11:23:33.023015 run osmo-hlr_10.42.42.2(pid=13596): stderr: | 20221213112329854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112329854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112329854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112329854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112329854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112329854 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112329903 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112329913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112329914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112329914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:33.095968 run osmo-msc_10.42.42.6(pid=13602): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13602)] 11:23:33.145993 run osmo-msc_10.42.42.6(pid=13602): stdout: | (launched: 2022-12-13_11:23:31.742963) 11:23:33.198162 run osmo-msc_10.42.42.6(pid=13602): stderr: | 20221213112332178 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112332178 DLGLOBAL DEBUG validating counter group 0x7f9bc24b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112332178 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112332178 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112332179 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112332179 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112332180 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112332181 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112332189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112332189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:23:33.250360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13595): Terminating (SIGTERM) 11:23:33.292336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13598): Terminating (SIGTERM) 11:23:33.334835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13601): Terminating (SIGTERM) 11:23:33.377670 --- ParallelTerminationStrategy: PID 13595 died... 11:23:33.398118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13595): Terminated: ok {rc=0} 11:23:33.444670 --- ParallelTerminationStrategy: PID 13598 died... 11:23:33.464469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13598): Terminated: ok {rc=0} 11:23:33.510768 --- ParallelTerminationStrategy: PID 13601 died... 11:23:33.530462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13601): Terminated: ok {rc=0} 11:23:33.618563 bus /sierra_3: Setting Powered False 11:23:34.716810 bus /sierra_3: Setting Powered False 11:23:35.831949 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:23:37.084219 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:23:37.089220 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:23:37.142298 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:23:37.168274 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:23:37.223673 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:23:37.276673 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:23:37.302511 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:23:37.849111 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:23:37.854115 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:23:37.864845 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:23:37.901375 tst handover.py: using LAC 33600 11:23:38.018511 tst handover.py: using RAC 195 11:23:38.136460 tst handover.py: using CellId 33600 11:23:38.252847 tst handover.py: using BVCI 33601 11:23:38.360913 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:23:38.408293 tst handover.py: using LAC 33601 11:23:38.534154 tst handover.py: using RAC 196 11:23:38.659580 tst handover.py: using CellId 33601 11:23:38.777900 tst handover.py: using BVCI 33602 11:23:38.888461 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:23:38.899512 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:23:38.910407 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:23:38.921281 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:23:38.932356 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:23:38.943671 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:23:39.060843 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:23:39.179449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:39.619119 run create_hlr_db(pid=13607): Launched 11:23:39.741675 bus /sierra_2: Setting Powered False 11:23:40.801837 run create_hlr_db(pid=13607): Terminated: ok {rc=0} 11:23:41.211536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13609): Launched 11:23:41.531339 run osmo-hlr_10.42.42.2(pid=13610): Launched 11:23:41.653922 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:42.156269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13612): Launched 11:23:42.454816 run osmo-stp_10.42.42.5(pid=13613): Launched 11:23:42.568875 run osmo-msc_10.42.42.6: Starting osmo-msc 11:23:43.082185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13615): Launched 11:23:43.380701 run osmo-msc_10.42.42.6(pid=13616): Launched 11:23:43.548714 run osmo-stp_10.42.42.5(pid=13613): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13613)] 11:23:43.674737 run osmo-stp_10.42.42.5(pid=13613): stdout: | (launched: 2022-12-13_11:23:42.400178) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:43.800774 run osmo-stp_10.42.42.5(pid=13613): stderr: | 20221213112342571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112342571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112342572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112342572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112342572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112342573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112342573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:43.924929 run osmo-stp_10.42.42.5(pid=13613): stdout: | (launched: 2022-12-13_11:23:42.400178) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:44.043223 run osmo-stp_10.42.42.5(pid=13613): stderr: | 20221213112342571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112342571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112342572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112342572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112342572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112342573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112342573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:44.184829 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=13613): Process ended prematurely: osmo-stp_10.42.42.5(pid=13613) [trial-2388↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13613)] [trial-2388↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 11:23:44.193108 tst handover.py:18: Test FAILED (6.3 sec) 11:23:44.218806 run osmo-hlr_10.42.42.2(pid=13610): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13610)] 11:23:44.266183 run osmo-hlr_10.42.42.2(pid=13610): stdout: | (launched: 2022-12-13_11:23:41.472596) 11:23:44.315279 run osmo-hlr_10.42.42.2(pid=13610): stderr: | 20221213112341672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112341672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112341672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112341673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112341673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112341673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112341685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112341693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112341694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112341694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:44.384174 run osmo-msc_10.42.42.6(pid=13616): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13616)] 11:23:44.431293 run osmo-msc_10.42.42.6(pid=13616): stdout: | (launched: 2022-12-13_11:23:43.326088) 11:23:44.480744 run osmo-msc_10.42.42.6(pid=13616): stderr: | 20221213112343595 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112343595 DLGLOBAL DEBUG validating counter group 0x7f684baa3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112343595 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112343596 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112343596 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112343596 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112343598 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112343598 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112343598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112343598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:23:44.530275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13609): Terminating (SIGTERM) 11:23:44.569671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13612): Terminating (SIGTERM) 11:23:44.609229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13615): Terminating (SIGTERM) 11:23:44.648832 --- ParallelTerminationStrategy: PID 13609 died... 11:23:44.667937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13609): Terminated: ok {rc=0} 11:23:44.711642 --- ParallelTerminationStrategy: PID 13612 died... 11:23:44.730146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13612): Terminated: ok {rc=0} 11:23:44.773865 --- ParallelTerminationStrategy: PID 13615 died... 11:23:44.792331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13615): Terminated: ok {rc=0} 11:23:44.875737 bus /sierra_3: Setting Powered False 11:23:45.984515 bus /sierra_3: Setting Powered False 11:23:47.132936 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 11:23:48.483245 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:23:48.492147 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:23:48.547277 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:23:48.586148 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:23:48.648736 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:23:48.707879 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:23:48.738384 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:23:49.269393 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 11:23:49.276482 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:23:49.288820 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 11:23:49.329950 tst handover.py: using LAC 33602 11:23:49.463366 tst handover.py: using RAC 197 11:23:49.593750 tst handover.py: using CellId 33602 11:23:49.724918 tst handover.py: using BVCI 33603 11:23:49.846842 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 11:23:49.882769 tst handover.py: using LAC 33603 11:23:50.012015 tst handover.py: using RAC 198 11:23:50.140026 tst handover.py: using CellId 33603 11:23:50.268467 tst handover.py: using BVCI 33604 11:23:50.391803 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:23:50.404176 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:23:50.416191 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:23:50.428441 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:23:50.441758 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:23:50.455005 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 11:23:50.581765 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 11:23:50.704306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:51.160790 run create_hlr_db(pid=13892): Launched 11:23:51.300026 bus /sierra_2: Setting Powered False 11:23:52.361169 run create_hlr_db(pid=13892): Terminated: ok {rc=0} 11:23:52.767366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13894): Launched 11:23:53.087638 run osmo-hlr_10.42.42.2(pid=13895): Launched 11:23:53.373618 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:54.065985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13897): Launched 11:23:54.384929 run osmo-stp_10.42.42.5(pid=13898): Launched 11:23:54.635552 run osmo-msc_10.42.42.6: Starting osmo-msc 11:23:55.284485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13900): Launched 11:23:55.629437 run osmo-msc_10.42.42.6(pid=13901): Launched 11:23:55.988868 run osmo-stp_10.42.42.5(pid=13898): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13898)] 11:23:56.240574 run osmo-stp_10.42.42.5(pid=13898): stdout: | (launched: 2022-12-13_11:23:54.323078) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:56.429425 run osmo-stp_10.42.42.5(pid=13898): stderr: | 20221213112354620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112354620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112354621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112354621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112354621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112354622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112354622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:56.570403 run osmo-stp_10.42.42.5(pid=13898): stdout: | (launched: 2022-12-13_11:23:54.323078) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:56.705864 run osmo-stp_10.42.42.5(pid=13898): stderr: | 20221213112354620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112354620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112354621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112354621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112354621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112354622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112354622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:56.868290 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=13898): Process ended prematurely: osmo-stp_10.42.42.5(pid=13898) [trial-2388↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13898)] [trial-2388↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 11:23:56.878391 tst handover.py:18: Test FAILED (7.6 sec) 11:23:56.907143 run osmo-hlr_10.42.42.2(pid=13895): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13895)] 11:23:56.962592 run osmo-hlr_10.42.42.2(pid=13895): stdout: | (launched: 2022-12-13_11:23:53.031472) 11:23:57.017631 run osmo-hlr_10.42.42.2(pid=13895): stderr: | 20221213112353407 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112353407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112353407 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112353407 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112353407 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112353407 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112353428 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112353436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112353436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112353436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:57.093508 run osmo-msc_10.42.42.6(pid=13901): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13901)] 11:23:57.145355 run osmo-msc_10.42.42.6(pid=13901): stdout: | (launched: 2022-12-13_11:23:55.567399) 11:23:57.201664 run osmo-msc_10.42.42.6(pid=13901): stderr: | 20221213112356070 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112356070 DLGLOBAL DEBUG validating counter group 0x7fbb712b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112356070 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112356070 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112356070 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112356071 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112356072 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112356077 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112356077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112356077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:23:57.257396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13894): Terminating (SIGTERM) 11:23:57.301067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13897): Terminating (SIGTERM) 11:23:57.347656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13900): Terminating (SIGTERM) 11:23:57.394884 --- ParallelTerminationStrategy: PID 13894 died... 11:23:57.417271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13894): Terminated: ok {rc=0} 11:23:57.467431 --- ParallelTerminationStrategy: PID 13897 died... 11:23:57.489839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13897): Terminated: ok {rc=0} 11:23:57.538657 --- ParallelTerminationStrategy: PID 13900 died... 11:23:57.560690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13900): Terminated: ok {rc=0} 11:23:57.653806 bus /sierra_3: Setting Powered False 11:23:58.757388 bus /sierra_3: Setting Powered False 11:23:59.881915 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 11:24:01.180669 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:24:01.187249 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:24:01.255998 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:24:01.286404 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:24:01.350169 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:24:01.436834 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:24:01.468817 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:24:01.995586 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 11:24:02.002738 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:24:02.019482 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:24:02.086555 tst handover.py: using LAC 33604 11:24:02.248594 tst handover.py: using RAC 199 11:24:02.412993 tst handover.py: using CellId 33604 11:24:02.561836 tst handover.py: using BVCI 33605 11:24:02.764247 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:24:02.857030 tst handover.py: using LAC 33605 11:24:03.002017 tst handover.py: using RAC 200 11:24:03.154408 tst handover.py: using CellId 33605 11:24:03.285321 tst handover.py: using BVCI 33606 11:24:03.409712 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:24:03.421968 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:24:03.434197 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:24:03.446364 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:24:03.459815 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:24:03.472923 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:24:03.601852 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:24:03.726630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:04.227547 run create_hlr_db(pid=13906): Launched 11:24:04.395619 bus /sierra_2: Setting Powered False 11:24:05.462159 run create_hlr_db(pid=13906): Terminated: ok {rc=0} 11:24:05.903890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13908): Launched 11:24:06.252570 run osmo-hlr_10.42.42.2(pid=13909): Launched 11:24:06.507753 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:07.159047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13911): Launched 11:24:07.514606 run osmo-stp_10.42.42.5(pid=13912): Launched 11:24:07.768774 run osmo-msc_10.42.42.6: Starting osmo-msc 11:24:08.436509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13914): Launched 11:24:08.791241 run osmo-msc_10.42.42.6(pid=13915): Launched 11:24:09.169696 run osmo-stp_10.42.42.5(pid=13912): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13912)] 11:24:09.317497 run osmo-stp_10.42.42.5(pid=13912): stdout: | (launched: 2022-12-13_11:24:07.448395) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:09.454386 run osmo-stp_10.42.42.5(pid=13912): stderr: | 20221213112407752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112407752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112407752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112407753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112407753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112407753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112407753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:09.590569 run osmo-stp_10.42.42.5(pid=13912): stdout: | (launched: 2022-12-13_11:24:07.448395) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:09.720914 run osmo-stp_10.42.42.5(pid=13912): stderr: | 20221213112407752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112407752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112407752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112407753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112407753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112407753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112407753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:09.876686 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=13912): Process ended prematurely: osmo-stp_10.42.42.5(pid=13912) [trial-2388↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13912)] [trial-2388↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 11:24:09.885622 tst handover.py:18: Test FAILED (7.9 sec) 11:24:09.912689 run osmo-hlr_10.42.42.2(pid=13909): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13909)] 11:24:09.963128 run osmo-hlr_10.42.42.2(pid=13909): stdout: | (launched: 2022-12-13_11:24:06.192355) 11:24:10.014897 run osmo-hlr_10.42.42.2(pid=13909): stderr: | 20221213112406501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112406501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112406501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112406501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112406501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112406501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112406521 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112406538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112406538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112406538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:10.087501 run osmo-msc_10.42.42.6(pid=13915): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13915)] 11:24:10.137348 run osmo-msc_10.42.42.6(pid=13915): stdout: | (launched: 2022-12-13_11:24:08.724759) 11:24:10.189254 run osmo-msc_10.42.42.6(pid=13915): stderr: | 20221213112409225 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112409225 DLGLOBAL DEBUG validating counter group 0x7f38a1194c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112409225 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112409225 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112409225 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112409226 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112409227 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112409228 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112409228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112409228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:24:10.241818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13908): Terminating (SIGTERM) 11:24:10.283836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13911): Terminating (SIGTERM) 11:24:10.325947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13914): Terminating (SIGTERM) 11:24:10.368092 --- ParallelTerminationStrategy: PID 13908 died... 11:24:10.387920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13908): Terminated: ok {rc=0} 11:24:10.434389 --- ParallelTerminationStrategy: PID 13911 died... 11:24:10.454029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13911): Terminated: ok {rc=0} 11:24:10.499949 --- ParallelTerminationStrategy: PID 13914 died... 11:24:10.519763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13914): Terminated: ok {rc=0} 11:24:10.607616 bus /sierra_3: Setting Powered False 11:24:11.706545 bus /sierra_3: Setting Powered False 11:24:12.821851 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 11:24:14.076336 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:24:14.081789 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:24:14.133583 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:24:14.159497 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:24:14.212064 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:24:14.266592 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:24:14.293662 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:24:14.846184 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 11:24:14.852866 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:24:14.864415 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:24:14.903778 tst handover.py: using LAC 33606 11:24:15.025228 tst handover.py: using RAC 201 11:24:15.142758 tst handover.py: using CellId 33606 11:24:15.262620 tst handover.py: using BVCI 33607 11:24:15.381846 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:24:15.428403 tst handover.py: using LAC 33607 11:24:15.555470 tst handover.py: using RAC 202 11:24:15.681495 tst handover.py: using CellId 33607 11:24:15.814907 tst handover.py: using BVCI 33608 11:24:15.948665 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:24:15.960545 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:24:15.973428 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:24:15.985170 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:24:15.997911 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:24:16.011013 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:24:16.133158 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:24:16.250901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:16.796424 run create_hlr_db(pid=13921): Launched 11:24:16.956847 bus /sierra_2: Setting Powered False 11:24:18.021623 run create_hlr_db(pid=13921): Terminated: ok {rc=0} 11:24:18.431217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13923): Launched 11:24:18.736109 run osmo-hlr_10.42.42.2(pid=13924): Launched 11:24:18.851912 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:19.367186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13926): Launched 11:24:19.670221 run osmo-stp_10.42.42.5(pid=13927): Launched 11:24:19.786063 run osmo-msc_10.42.42.6: Starting osmo-msc 11:24:20.308025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13929): Launched 11:24:20.611019 run osmo-msc_10.42.42.6(pid=13930): Launched 11:24:20.780590 run osmo-stp_10.42.42.5(pid=13927): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13927)] 11:24:20.915602 run osmo-stp_10.42.42.5(pid=13927): stdout: | (launched: 2022-12-13_11:24:19.614228) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:21.055503 run osmo-stp_10.42.42.5(pid=13927): stderr: | 20221213112419786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112419786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112419786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112419787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112419787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112419787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112419787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:21.190446 run osmo-stp_10.42.42.5(pid=13927): stdout: | (launched: 2022-12-13_11:24:19.614228) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:21.320479 run osmo-stp_10.42.42.5(pid=13927): stderr: | 20221213112419786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112419786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112419786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112419787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112419787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112419787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112419787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:21.475394 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=13927): Process ended prematurely: osmo-stp_10.42.42.5(pid=13927) [trial-2388↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13927)] [trial-2388↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 11:24:21.484221 tst handover.py:18: Test FAILED (6.6 sec) 11:24:21.511460 run osmo-hlr_10.42.42.2(pid=13924): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13924)] 11:24:21.562961 run osmo-hlr_10.42.42.2(pid=13924): stdout: | (launched: 2022-12-13_11:24:18.680260) 11:24:21.614867 run osmo-hlr_10.42.42.2(pid=13924): stderr: | 20221213112418861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112418861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112418861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112418861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112418861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112418861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112418877 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112418885 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112418885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112418885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:21.687538 run osmo-msc_10.42.42.6(pid=13930): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13930)] 11:24:21.737331 run osmo-msc_10.42.42.6(pid=13930): stdout: | (launched: 2022-12-13_11:24:20.555092) 11:24:21.789055 run osmo-msc_10.42.42.6(pid=13930): stderr: | 20221213112420828 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112420829 DLGLOBAL DEBUG validating counter group 0x7f4d6a04fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112420829 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112420829 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112420829 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112420829 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112420831 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112420832 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112420832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112420832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:24:21.841310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13923): Terminating (SIGTERM) 11:24:21.883130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13926): Terminating (SIGTERM) 11:24:21.924891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13929): Terminating (SIGTERM) 11:24:21.967765 --- ParallelTerminationStrategy: PID 13923 died... 11:24:21.988202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13923): Terminated: ok {rc=0} 11:24:22.034876 --- ParallelTerminationStrategy: PID 13926 died... 11:24:22.054758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13926): Terminated: ok {rc=0} 11:24:22.101259 --- ParallelTerminationStrategy: PID 13929 died... 11:24:22.121138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13929): Terminated: ok {rc=0} 11:24:22.209217 bus /sierra_3: Setting Powered False 11:24:23.308056 bus /sierra_3: Setting Powered False 11:24:24.421411 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 11:24:25.680245 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:24:25.686188 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 11:24:25.723694 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 11:24:25.750805 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 11:24:25.802988 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 11:24:25.840676 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 11:24:25.868105 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 11:24:26.417830 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 11:24:26.423144 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:24:26.434360 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 11:24:26.468179 tst handover.py: using LAC 33608 11:24:26.588258 tst handover.py: using RAC 203 11:24:26.716604 tst handover.py: using CellId 33608 11:24:26.844076 tst handover.py: using BVCI 33609 11:24:26.956059 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 11:24:26.994679 tst handover.py: using LAC 33609 11:24:27.116497 tst handover.py: using RAC 204 11:24:27.236658 tst handover.py: using CellId 33609 11:24:27.354471 tst handover.py: using BVCI 33610 11:24:27.467022 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:24:27.477708 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:24:27.488150 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:24:27.498578 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:24:27.509027 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:24:27.519750 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 11:24:27.640348 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 11:24:27.763282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:28.240904 run create_hlr_db(pid=13935): Launched 11:24:28.367292 bus /sierra_2: Setting Powered False 11:24:29.430946 run create_hlr_db(pid=13935): Terminated: ok {rc=0} 11:24:29.839284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13937): Launched 11:24:30.143341 run osmo-hlr_10.42.42.2(pid=13938): Launched 11:24:30.259523 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:30.777089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13940): Launched 11:24:31.119094 run osmo-stp_10.42.42.5(pid=13941): Launched 11:24:31.313782 run osmo-msc_10.42.42.6: Starting osmo-msc 11:24:31.943136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13943): Launched 11:24:32.277714 run osmo-msc_10.42.42.6(pid=13944): Launched 11:24:32.475421 run osmo-stp_10.42.42.5(pid=13941): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13941)] 11:24:32.604361 run osmo-stp_10.42.42.5(pid=13941): stdout: | (launched: 2022-12-13_11:24:31.055495) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:32.733104 run osmo-stp_10.42.42.5(pid=13941): stderr: | 20221213112431343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112431343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112431344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112431344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112431345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112431345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112431345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:32.859962 run osmo-stp_10.42.42.5(pid=13941): stdout: | (launched: 2022-12-13_11:24:31.055495) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:32.981281 run osmo-stp_10.42.42.5(pid=13941): stderr: | 20221213112431343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112431343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112431344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112431344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112431345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112431345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112431345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:33.126240 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=13941): Process ended prematurely: osmo-stp_10.42.42.5(pid=13941) [trial-2388↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13941)] [trial-2388↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 11:24:33.134435 tst handover.py:18: Test FAILED (6.7 sec) 11:24:33.160293 run osmo-hlr_10.42.42.2(pid=13938): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13938)] 11:24:33.207994 run osmo-hlr_10.42.42.2(pid=13938): stdout: | (launched: 2022-12-13_11:24:30.088133) 11:24:33.257533 run osmo-hlr_10.42.42.2(pid=13938): stderr: | 20221213112430265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112430265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112430265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112430265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112430265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112430265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112430276 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112430285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112430285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112430285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:33.326776 run osmo-msc_10.42.42.6(pid=13944): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13944)] 11:24:33.374571 run osmo-msc_10.42.42.6(pid=13944): stdout: | (launched: 2022-12-13_11:24:32.209424) 11:24:33.424000 run osmo-msc_10.42.42.6(pid=13944): stderr: | 20221213112432524 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112432524 DLGLOBAL DEBUG validating counter group 0x7f4052ec5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112432525 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112432525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112432525 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112432525 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112432527 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112432527 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112432527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112432528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:24:33.473905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13937): Terminating (SIGTERM) 11:24:33.513879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13940): Terminating (SIGTERM) 11:24:33.553826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13943): Terminating (SIGTERM) 11:24:33.593997 --- ParallelTerminationStrategy: PID 13937 died... 11:24:33.613178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13937): Terminated: ok {rc=0} 11:24:33.657616 --- ParallelTerminationStrategy: PID 13940 died... 11:24:33.676381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13940): Terminated: ok {rc=0} 11:24:33.720412 --- ParallelTerminationStrategy: PID 13943 died... 11:24:33.739200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13943): Terminated: ok {rc=0} 11:24:33.826184 bus /sierra_3: Setting Powered False 11:24:34.925744 bus /sierra_3: Setting Powered False 11:24:36.042285 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 11:24:37.287686 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:24:37.293596 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 11:24:37.345542 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 11:24:37.372643 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 11:24:37.424307 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 11:24:37.475242 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 11:24:37.502401 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 11:24:38.054073 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 11:24:38.060038 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:24:38.071480 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:24:38.105669 tst handover.py: using LAC 33610 11:24:38.228253 tst handover.py: using RAC 205 11:24:38.348506 tst handover.py: using CellId 33610 11:24:38.468565 tst handover.py: using BVCI 33611 11:24:38.579902 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:24:38.628055 tst handover.py: using LAC 33611 11:24:38.748483 tst handover.py: using RAC 206 11:24:38.869218 tst handover.py: using CellId 33611 11:24:38.988025 tst handover.py: using BVCI 33612 11:24:39.100111 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:24:39.110838 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:24:39.121358 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:24:39.131749 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:24:39.142275 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:24:39.152769 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:24:39.274732 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:24:39.390481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:39.836179 run create_hlr_db(pid=13949): Launched 11:24:39.961752 bus /sierra_2: Setting Powered False 11:24:41.022157 run create_hlr_db(pid=13949): Terminated: ok {rc=0} 11:24:41.420460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13951): Launched 11:24:41.724091 run osmo-hlr_10.42.42.2(pid=13952): Launched 11:24:41.838998 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:42.350201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13954): Launched 11:24:42.652598 run osmo-stp_10.42.42.5(pid=13955): Launched 11:24:42.768097 run osmo-msc_10.42.42.6: Starting osmo-msc 11:24:43.289690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13957): Launched 11:24:43.592807 run osmo-msc_10.42.42.6(pid=13958): Launched 11:24:43.762944 run osmo-stp_10.42.42.5(pid=13955): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13955)] 11:24:43.891103 run osmo-stp_10.42.42.5(pid=13955): stdout: | (launched: 2022-12-13_11:24:42.597436) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:44.019710 run osmo-stp_10.42.42.5(pid=13955): stderr: | 20221213112442770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112442770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112442770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112442771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112442771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112442771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112442771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:44.146404 run osmo-stp_10.42.42.5(pid=13955): stdout: | (launched: 2022-12-13_11:24:42.597436) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:44.267476 run osmo-stp_10.42.42.5(pid=13955): stderr: | 20221213112442770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112442770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112442770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112442771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112442771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112442771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112442771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:44.411444 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=13955): Process ended prematurely: osmo-stp_10.42.42.5(pid=13955) [trial-2388↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13955)] [trial-2388↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 11:24:44.419816 tst handover.py:18: Test FAILED (6.4 sec) 11:24:44.445788 run osmo-hlr_10.42.42.2(pid=13952): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13952)] 11:24:44.493932 run osmo-hlr_10.42.42.2(pid=13952): stdout: | (launched: 2022-12-13_11:24:41.668795) 11:24:44.542963 run osmo-hlr_10.42.42.2(pid=13952): stderr: | 20221213112441845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112441845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112441845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112441846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112441846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112441846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112441858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112441867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112441867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112441867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:44.611510 run osmo-msc_10.42.42.6(pid=13958): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13958)] 11:24:44.658799 run osmo-msc_10.42.42.6(pid=13958): stdout: | (launched: 2022-12-13_11:24:43.537293) 11:24:44.707537 run osmo-msc_10.42.42.6(pid=13958): stderr: | 20221213112443810 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112443810 DLGLOBAL DEBUG validating counter group 0x7f2f6b1bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112443810 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112443811 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112443811 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112443811 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112443813 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112443813 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112443813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112443813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:24:44.757109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13951): Terminating (SIGTERM) 11:24:44.796442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13954): Terminating (SIGTERM) 11:24:44.835665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13957): Terminating (SIGTERM) 11:24:44.875314 --- ParallelTerminationStrategy: PID 13951 died... 11:24:44.894278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13951): Terminated: ok {rc=0} 11:24:44.938041 --- ParallelTerminationStrategy: PID 13954 died... 11:24:44.956337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13954): Terminated: ok {rc=0} 11:24:44.999974 --- ParallelTerminationStrategy: PID 13957 died... 11:24:45.018423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13957): Terminated: ok {rc=0} 11:24:45.103561 bus /sierra_3: Setting Powered False 11:24:46.202963 bus /sierra_3: Setting Powered False 11:24:47.321535 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:24:48.576212 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:24:48.581304 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:24:48.626935 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:24:48.653088 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:24:48.704550 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:24:48.751547 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:24:48.778440 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:24:49.331322 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:24:49.337114 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:24:49.348641 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:24:49.383153 tst handover.py: using LAC 33612 11:24:49.511162 tst handover.py: using RAC 207 11:24:49.638692 tst handover.py: using CellId 33612 11:24:49.765751 tst handover.py: using BVCI 33613 11:24:49.883923 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:24:49.929453 tst handover.py: using LAC 33613 11:24:50.058636 tst handover.py: using RAC 208 11:24:50.186157 tst handover.py: using CellId 33613 11:24:50.315426 tst handover.py: using BVCI 33614 11:24:50.433852 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:24:50.445227 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:24:50.456249 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:24:50.467367 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:24:50.479084 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:24:50.490596 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:24:50.609900 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:24:50.727973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:51.173610 run create_hlr_db(pid=13963): Launched 11:24:51.297770 bus /sierra_2: Setting Powered False 11:24:52.358239 run create_hlr_db(pid=13963): Terminated: ok {rc=0} 11:24:52.775520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13965): Launched 11:24:53.101682 run osmo-hlr_10.42.42.2(pid=13966): Launched 11:24:53.226926 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:53.728100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13968): Launched 11:24:54.033189 run osmo-stp_10.42.42.5(pid=13969): Launched 11:24:54.150907 run osmo-msc_10.42.42.6: Starting osmo-msc 11:24:54.675361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13971): Launched 11:24:54.981056 run osmo-msc_10.42.42.6(pid=13972): Launched 11:24:55.151518 run osmo-stp_10.42.42.5(pid=13969): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13969)] 11:24:55.280367 run osmo-stp_10.42.42.5(pid=13969): stdout: | (launched: 2022-12-13_11:24:53.977440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:55.410239 run osmo-stp_10.42.42.5(pid=13969): stderr: | 20221213112454148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112454148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112454149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112454149 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112454149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112454150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112454150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:55.537439 run osmo-stp_10.42.42.5(pid=13969): stdout: | (launched: 2022-12-13_11:24:53.977440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:55.658880 run osmo-stp_10.42.42.5(pid=13969): stderr: | 20221213112454148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112454148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112454149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112454149 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112454149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112454150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112454150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:55.804016 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=13969): Process ended prematurely: osmo-stp_10.42.42.5(pid=13969) [trial-2388↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13969)] [trial-2388↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 11:24:55.812442 tst handover.py:18: Test FAILED (6.5 sec) 11:24:55.838505 run osmo-hlr_10.42.42.2(pid=13966): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13966)] 11:24:55.886582 run osmo-hlr_10.42.42.2(pid=13966): stdout: | (launched: 2022-12-13_11:24:53.042246) 11:24:55.935935 run osmo-hlr_10.42.42.2(pid=13966): stderr: | 20221213112453241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112453241 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112453241 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112453241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112453241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112453241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112453253 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112453261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112453262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112453262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:56.004696 run osmo-msc_10.42.42.6(pid=13972): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13972)] 11:24:56.052528 run osmo-msc_10.42.42.6(pid=13972): stdout: | (launched: 2022-12-13_11:24:54.923438) 11:24:56.102175 run osmo-msc_10.42.42.6(pid=13972): stderr: | 20221213112455198 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112455198 DLGLOBAL DEBUG validating counter group 0x7fc4ea74cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112455198 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112455198 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112455198 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112455199 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112455200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112455201 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112455201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112455201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:24:56.152041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13965): Terminating (SIGTERM) 11:24:56.191539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13968): Terminating (SIGTERM) 11:24:56.231132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13971): Terminating (SIGTERM) 11:24:56.270752 --- ParallelTerminationStrategy: PID 13965 died... 11:24:56.290143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13965): Terminated: ok {rc=0} 11:24:56.333885 --- ParallelTerminationStrategy: PID 13968 died... 11:24:56.352573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13968): Terminated: ok {rc=0} 11:24:56.396556 --- ParallelTerminationStrategy: PID 13971 died... 11:24:56.415300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13971): Terminated: ok {rc=0} 11:24:56.500500 bus /sierra_3: Setting Powered False 11:24:57.599908 bus /sierra_3: Setting Powered False 11:24:58.712079 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:24:59.968286 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:24:59.974329 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:25:00.024523 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:25:00.050658 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:25:00.102122 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:25:00.155743 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:25:00.182888 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:25:00.732616 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:25:00.738345 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:25:00.749801 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:25:00.787297 tst handover.py: using LAC 33614 11:25:00.909734 tst handover.py: using RAC 209 11:25:01.042197 tst handover.py: using CellId 33614 11:25:01.167614 tst handover.py: using BVCI 33615 11:25:01.290232 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:25:01.351036 tst handover.py: using LAC 33615 11:25:01.482172 tst handover.py: using RAC 210 11:25:01.630300 tst handover.py: using CellId 33615 11:25:01.751477 tst handover.py: using BVCI 33616 11:25:01.906938 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:25:01.920699 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:25:01.938096 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:25:01.957849 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:25:01.974784 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:25:01.995439 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:25:02.128278 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:25:02.251159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:02.733600 run create_hlr_db(pid=13980): Launched 11:25:02.859251 bus /sierra_2: Setting Powered False 11:25:03.923151 run create_hlr_db(pid=13980): Terminated: ok {rc=0} 11:25:04.349115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13982): Launched 11:25:04.674617 run osmo-hlr_10.42.42.2(pid=13983): Launched 11:25:04.800745 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:05.335256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13985): Launched 11:25:05.661470 run osmo-stp_10.42.42.5(pid=13986): Launched 11:25:05.787885 run osmo-msc_10.42.42.6: Starting osmo-msc 11:25:06.349100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13988): Launched 11:25:06.674785 run osmo-msc_10.42.42.6(pid=13989): Launched 11:25:06.858828 run osmo-stp_10.42.42.5(pid=13986): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13986)] 11:25:06.997239 run osmo-stp_10.42.42.5(pid=13986): stdout: | (launched: 2022-12-13_11:25:05.602314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:07.135856 run osmo-stp_10.42.42.5(pid=13986): stderr: | 20221213112505795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112505795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112505795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112505796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112505796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112505796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112505797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:07.274301 run osmo-stp_10.42.42.5(pid=13986): stdout: | (launched: 2022-12-13_11:25:05.602314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:07.405159 run osmo-stp_10.42.42.5(pid=13986): stderr: | 20221213112505795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112505795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112505795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112505796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112505796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112505796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112505797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:07.561183 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=13986): Process ended prematurely: osmo-stp_10.42.42.5(pid=13986) [trial-2388↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13986)] [trial-2388↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 11:25:07.570032 tst handover.py:18: Test FAILED (6.8 sec) 11:25:07.597540 run osmo-hlr_10.42.42.2(pid=13983): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13983)] 11:25:07.648420 run osmo-hlr_10.42.42.2(pid=13983): stdout: | (launched: 2022-12-13_11:25:04.615639) 11:25:07.700515 run osmo-hlr_10.42.42.2(pid=13983): stderr: | 20221213112504815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112504815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112504815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112504815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112504815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112504815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112504827 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112504835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112504836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112504836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:07.773300 run osmo-msc_10.42.42.6(pid=13989): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13989)] 11:25:07.823155 run osmo-msc_10.42.42.6(pid=13989): stdout: | (launched: 2022-12-13_11:25:06.615821) 11:25:07.875056 run osmo-msc_10.42.42.6(pid=13989): stderr: | 20221213112506936 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112506936 DLGLOBAL DEBUG validating counter group 0x7fb256407c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112506936 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112506936 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112506937 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112506937 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112506938 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112506939 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112506939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112506939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:25:07.927750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13982): Terminating (SIGTERM) 11:25:07.969652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13985): Terminating (SIGTERM) 11:25:08.011793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13988): Terminating (SIGTERM) 11:25:08.054027 --- ParallelTerminationStrategy: PID 13982 died... 11:25:08.074554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13982): Terminated: ok {rc=0} 11:25:08.120886 --- ParallelTerminationStrategy: PID 13985 died... 11:25:08.141394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13985): Terminated: ok {rc=0} 11:25:08.187892 --- ParallelTerminationStrategy: PID 13988 died... 11:25:08.207862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13988): Terminated: ok {rc=0} 11:25:08.296014 bus /sierra_3: Setting Powered False 11:25:09.396051 bus /sierra_3: Setting Powered False 11:25:10.511544 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 11:25:11.772763 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:25:11.778413 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:25:11.817608 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:25:11.845036 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:25:11.898272 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:25:11.936597 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:25:11.963728 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:25:12.513736 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 11:25:12.520204 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:25:12.533850 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 11:25:12.567681 tst handover.py: using LAC 33616 11:25:12.696177 tst handover.py: using RAC 211 11:25:12.819168 tst handover.py: using CellId 33616 11:25:12.940479 tst handover.py: using BVCI 33617 11:25:13.052009 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 11:25:13.086952 tst handover.py: using LAC 33617 11:25:13.209099 tst handover.py: using RAC 212 11:25:13.328020 tst handover.py: using CellId 33617 11:25:13.449340 tst handover.py: using BVCI 33618 11:25:13.559299 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:25:13.570026 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:25:13.580588 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:25:13.591163 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:25:13.601675 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:25:13.612141 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 11:25:13.730827 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 11:25:13.846603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:14.291184 run create_hlr_db(pid=13994): Launched 11:25:14.415523 bus /sierra_2: Setting Powered False 11:25:15.477326 run create_hlr_db(pid=13994): Terminated: ok {rc=0} 11:25:15.896820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13996): Launched 11:25:16.247070 run osmo-hlr_10.42.42.2(pid=13997): Launched 11:25:16.410271 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:17.033707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13999): Launched 11:25:17.353605 run osmo-stp_10.42.42.5(pid=14000): Launched 11:25:17.484402 run osmo-msc_10.42.42.6: Starting osmo-msc 11:25:18.010699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14002): Launched 11:25:18.315928 run osmo-msc_10.42.42.6(pid=14003): Launched 11:25:18.485632 run osmo-stp_10.42.42.5(pid=14000): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14000)] 11:25:18.613712 run osmo-stp_10.42.42.5(pid=14000): stdout: | (launched: 2022-12-13_11:25:17.297553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:18.742236 run osmo-stp_10.42.42.5(pid=14000): stderr: | 20221213112517485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112517485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112517486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112517486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112517486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112517487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112517487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:18.869790 run osmo-stp_10.42.42.5(pid=14000): stdout: | (launched: 2022-12-13_11:25:17.297553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:18.991412 run osmo-stp_10.42.42.5(pid=14000): stderr: | 20221213112517485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112517485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112517486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112517486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112517486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112517487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112517487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:19.136875 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14000): Process ended prematurely: osmo-stp_10.42.42.5(pid=14000) [trial-2388↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14000)] [trial-2388↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 11:25:19.145133 tst handover.py:18: Test FAILED (6.6 sec) 11:25:19.170963 run osmo-hlr_10.42.42.2(pid=13997): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13997)] 11:25:19.218332 run osmo-hlr_10.42.42.2(pid=13997): stdout: | (launched: 2022-12-13_11:25:16.189448) 11:25:19.267635 run osmo-hlr_10.42.42.2(pid=13997): stderr: | 20221213112516577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112516577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112516577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112516577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112516577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112516578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112516594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112516606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112516607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112516607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:19.336628 run osmo-msc_10.42.42.6(pid=14003): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14003)] 11:25:19.384384 run osmo-msc_10.42.42.6(pid=14003): stdout: | (launched: 2022-12-13_11:25:18.259578) 11:25:19.433572 run osmo-msc_10.42.42.6(pid=14003): stderr: | 20221213112518533 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112518533 DLGLOBAL DEBUG validating counter group 0x7fdc9fce0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112518533 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112518533 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112518533 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112518534 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112518535 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112518536 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112518536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112518536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:25:19.483076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13996): Terminating (SIGTERM) 11:25:19.522530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13999): Terminating (SIGTERM) 11:25:19.561937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14002): Terminating (SIGTERM) 11:25:19.601679 --- ParallelTerminationStrategy: PID 13996 died... 11:25:19.620635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13996): Terminated: ok {rc=0} 11:25:19.664622 --- ParallelTerminationStrategy: PID 13999 died... 11:25:19.683250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13999): Terminated: ok {rc=0} 11:25:19.726939 --- ParallelTerminationStrategy: PID 14002 died... 11:25:19.745545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14002): Terminated: ok {rc=0} 11:25:19.829139 bus /sierra_3: Setting Powered False 11:25:20.927315 bus /sierra_3: Setting Powered False 11:25:22.046303 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 11:25:23.289265 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:25:23.295059 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:25:23.347492 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:25:23.374658 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:25:23.426852 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:25:23.478372 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:25:23.505513 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:25:24.058744 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 11:25:24.064638 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:25:24.076072 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:25:24.111144 tst handover.py: using LAC 33618 11:25:24.239588 tst handover.py: using RAC 213 11:25:24.369881 tst handover.py: using CellId 33618 11:25:24.493640 tst handover.py: using BVCI 33619 11:25:24.606356 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:25:24.652810 tst handover.py: using LAC 33619 11:25:24.771564 tst handover.py: using RAC 214 11:25:24.892354 tst handover.py: using CellId 33619 11:25:25.015432 tst handover.py: using BVCI 33620 11:25:25.127632 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:25:25.138419 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:25:25.148821 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:25:25.159358 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:25:25.169907 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:25:25.180834 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:25:25.305503 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:25:25.422916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:25.901715 run create_hlr_db(pid=14008): Launched 11:25:26.025864 bus /sierra_2: Setting Powered False 11:25:27.089768 run create_hlr_db(pid=14008): Terminated: ok {rc=0} 11:25:27.515059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14010): Launched 11:25:27.840820 run osmo-hlr_10.42.42.2(pid=14011): Launched 11:25:27.966872 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:28.501459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14013): Launched 11:25:28.826311 run osmo-stp_10.42.42.5(pid=14014): Launched 11:25:28.951226 run osmo-msc_10.42.42.6: Starting osmo-msc 11:25:29.511837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14016): Launched 11:25:29.839646 run osmo-msc_10.42.42.6(pid=14017): Launched 11:25:30.023626 run osmo-stp_10.42.42.5(pid=14014): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14014)] 11:25:30.160826 run osmo-stp_10.42.42.5(pid=14014): stdout: | (launched: 2022-12-13_11:25:28.767066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:30.299304 run osmo-stp_10.42.42.5(pid=14014): stderr: | 20221213112528960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112528960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112528961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112528961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112528961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112528961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112528962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:30.437185 run osmo-stp_10.42.42.5(pid=14014): stdout: | (launched: 2022-12-13_11:25:28.767066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:30.567769 run osmo-stp_10.42.42.5(pid=14014): stderr: | 20221213112528960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112528960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112528961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112528961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112528961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112528961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112528962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:30.723514 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14014): Process ended prematurely: osmo-stp_10.42.42.5(pid=14014) [trial-2388↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14014)] [trial-2388↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 11:25:30.732449 tst handover.py:18: Test FAILED (6.7 sec) 11:25:30.759759 run osmo-hlr_10.42.42.2(pid=14011): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14011)] 11:25:30.811014 run osmo-hlr_10.42.42.2(pid=14011): stdout: | (launched: 2022-12-13_11:25:27.781833) 11:25:30.867594 run osmo-hlr_10.42.42.2(pid=14011): stderr: | 20221213112527980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112527980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112527980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112527981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112527981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112527981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112527993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112528001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112528001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112528001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:30.943506 run osmo-msc_10.42.42.6(pid=14017): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14017)] 11:25:30.995098 run osmo-msc_10.42.42.6(pid=14017): stdout: | (launched: 2022-12-13_11:25:29.779477) 11:25:31.049919 run osmo-msc_10.42.42.6(pid=14017): stderr: | 20221213112530100 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112530100 DLGLOBAL DEBUG validating counter group 0x7f5f8e9eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112530100 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112530100 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112530101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112530101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112530102 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112530103 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112530103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112530103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:25:31.108329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14010): Terminating (SIGTERM) 11:25:31.159847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14013): Terminating (SIGTERM) 11:25:31.213209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14016): Terminating (SIGTERM) 11:25:31.266549 --- ParallelTerminationStrategy: PID 14010 died... 11:25:31.291074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14010): Terminated: ok {rc=0} 11:25:31.348118 --- ParallelTerminationStrategy: PID 14013 died... 11:25:31.369950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14013): Terminated: ok {rc=0} 11:25:31.418956 --- ParallelTerminationStrategy: PID 14016 died... 11:25:31.440207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14016): Terminated: ok {rc=0} 11:25:31.533196 bus /sierra_3: Setting Powered False 11:25:32.633613 bus /sierra_3: Setting Powered False 11:25:33.749291 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 11:25:35.004523 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:25:35.010050 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:25:35.061711 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:25:35.088789 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:25:35.141151 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:25:35.191096 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:25:35.217450 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:25:35.769657 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 11:25:35.776299 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:25:35.788129 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:25:35.823589 tst handover.py: using LAC 33620 11:25:35.955512 tst handover.py: using RAC 215 11:25:36.076185 tst handover.py: using CellId 33620 11:25:36.195042 tst handover.py: using BVCI 33621 11:25:36.307166 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:25:36.353230 tst handover.py: using LAC 33621 11:25:36.473497 tst handover.py: using RAC 216 11:25:36.601370 tst handover.py: using CellId 33621 11:25:36.726858 tst handover.py: using BVCI 33622 11:25:36.844791 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:25:36.855998 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:25:36.866944 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:25:36.878036 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:25:36.889505 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:25:36.900802 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:25:37.018441 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:25:37.138197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:37.616170 run create_hlr_db(pid=14022): Launched 11:25:37.740282 bus /sierra_2: Setting Powered False 11:25:38.805074 run create_hlr_db(pid=14022): Terminated: ok {rc=0} 11:25:39.230467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14024): Launched 11:25:39.557645 run osmo-hlr_10.42.42.2(pid=14025): Launched 11:25:39.683613 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:40.202734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14027): Launched 11:25:40.506745 run osmo-stp_10.42.42.5(pid=14028): Launched 11:25:40.623723 run osmo-msc_10.42.42.6: Starting osmo-msc 11:25:41.146912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14030): Launched 11:25:41.450622 run osmo-msc_10.42.42.6(pid=14031): Launched 11:25:41.622247 run osmo-stp_10.42.42.5(pid=14028): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14028)] 11:25:41.752315 run osmo-stp_10.42.42.5(pid=14028): stdout: | (launched: 2022-12-13_11:25:40.451382) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:41.881897 run osmo-stp_10.42.42.5(pid=14028): stderr: | 20221213112540620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112540620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112540620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112540621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112540623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112540623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112540623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:42.008404 run osmo-stp_10.42.42.5(pid=14028): stdout: | (launched: 2022-12-13_11:25:40.451382) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:42.129571 run osmo-stp_10.42.42.5(pid=14028): stderr: | 20221213112540620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112540620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112540620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112540621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112540623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112540623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112540623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:42.274717 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14028): Process ended prematurely: osmo-stp_10.42.42.5(pid=14028) [trial-2388↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14028)] [trial-2388↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 11:25:42.282924 tst handover.py:18: Test FAILED (6.5 sec) 11:25:42.309018 run osmo-hlr_10.42.42.2(pid=14025): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14025)] 11:25:42.357783 run osmo-hlr_10.42.42.2(pid=14025): stdout: | (launched: 2022-12-13_11:25:39.498734) 11:25:42.407586 run osmo-hlr_10.42.42.2(pid=14025): stderr: | 20221213112539698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112539698 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112539698 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112539699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112539699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112539699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112539710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112539719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112539719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112539719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:42.477317 run osmo-msc_10.42.42.6(pid=14031): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14031)] 11:25:42.525174 run osmo-msc_10.42.42.6(pid=14031): stdout: | (launched: 2022-12-13_11:25:41.394983) 11:25:42.575269 run osmo-msc_10.42.42.6(pid=14031): stderr: | 20221213112541665 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112541666 DLGLOBAL DEBUG validating counter group 0x7f7fe5decc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112541666 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112541666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112541666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112541666 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112541668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112541668 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112541668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112541668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:25:42.625120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14024): Terminating (SIGTERM) 11:25:42.664624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14027): Terminating (SIGTERM) 11:25:42.704132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14030): Terminating (SIGTERM) 11:25:42.743740 --- ParallelTerminationStrategy: PID 14024 died... 11:25:42.762838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14024): Terminated: ok {rc=0} 11:25:42.806576 --- ParallelTerminationStrategy: PID 14027 died... 11:25:42.825158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14027): Terminated: ok {rc=0} 11:25:42.868411 --- ParallelTerminationStrategy: PID 14030 died... 11:25:42.887002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14030): Terminated: ok {rc=0} 11:25:42.969497 bus /sierra_3: Setting Powered False 11:25:44.067215 bus /sierra_3: Setting Powered False 11:25:45.186522 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 11:25:46.494954 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:25:46.501946 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 11:25:46.554903 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 11:25:46.582715 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 11:25:46.634708 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 11:25:46.685188 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 11:25:46.712649 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 11:25:47.261643 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 11:25:47.268270 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:25:47.280123 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:25:47.318250 tst handover.py: using LAC 33622 11:25:47.437361 tst handover.py: using RAC 217 11:25:47.554791 tst handover.py: using CellId 33622 11:25:47.672634 tst handover.py: using BVCI 33623 11:25:47.782181 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:25:47.828289 tst handover.py: using LAC 33623 11:25:47.952715 tst handover.py: using RAC 218 11:25:48.071501 tst handover.py: using CellId 33623 11:25:48.189406 tst handover.py: using BVCI 33624 11:25:48.311217 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:25:48.322595 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:25:48.333748 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:25:48.345008 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:25:48.357431 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:25:48.369458 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:25:48.486890 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:25:48.608607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:49.085671 run create_hlr_db(pid=14037): Launched 11:25:49.210129 bus /sierra_2: Setting Powered False 11:25:50.274114 run create_hlr_db(pid=14037): Terminated: ok {rc=0} 11:25:50.683933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14039): Launched 11:25:50.988774 run osmo-hlr_10.42.42.2(pid=14040): Launched 11:25:51.105355 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:51.618100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14042): Launched 11:25:51.932395 run osmo-stp_10.42.42.5(pid=14046): Launched 11:25:52.058986 run osmo-msc_10.42.42.6: Starting osmo-msc 11:25:52.625569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14048): Launched 11:25:52.952247 run osmo-msc_10.42.42.6(pid=14049): Launched 11:25:53.134236 run osmo-stp_10.42.42.5(pid=14046): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14046)] 11:25:53.272134 run osmo-stp_10.42.42.5(pid=14046): stdout: | (launched: 2022-12-13_11:25:51.872489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:53.410811 run osmo-stp_10.42.42.5(pid=14046): stderr: | 20221213112552066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112552066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112552067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112552067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112552067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112552067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112552068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:53.547951 run osmo-stp_10.42.42.5(pid=14046): stdout: | (launched: 2022-12-13_11:25:51.872489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:53.678481 run osmo-stp_10.42.42.5(pid=14046): stderr: | 20221213112552066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112552066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112552067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112552067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112552067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112552067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112552068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:53.833813 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14046): Process ended prematurely: osmo-stp_10.42.42.5(pid=14046) [trial-2388↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14046)] [trial-2388↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 11:25:53.842802 tst handover.py:18: Test FAILED (6.6 sec) 11:25:53.870089 run osmo-hlr_10.42.42.2(pid=14040): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14040)] 11:25:53.920366 run osmo-hlr_10.42.42.2(pid=14040): stdout: | (launched: 2022-12-13_11:25:50.932772) 11:25:53.972079 run osmo-hlr_10.42.42.2(pid=14040): stderr: | 20221213112551108 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112551108 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112551108 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112551108 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112551108 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112551108 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112551121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112551130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112551130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112551130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:54.044512 run osmo-msc_10.42.42.6(pid=14049): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14049)] 11:25:54.094026 run osmo-msc_10.42.42.6(pid=14049): stdout: | (launched: 2022-12-13_11:25:52.893474) 11:25:54.145719 run osmo-msc_10.42.42.6(pid=14049): stderr: | 20221213112553214 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112553214 DLGLOBAL DEBUG validating counter group 0x7fdbf7249c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112553214 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112553214 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112553214 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112553214 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112553216 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112553216 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112553216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112553217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:25:54.197686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14039): Terminating (SIGTERM) 11:25:54.239387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14042): Terminating (SIGTERM) 11:25:54.281619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14048): Terminating (SIGTERM) 11:25:54.324306 --- ParallelTerminationStrategy: PID 14039 died... 11:25:54.344559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14039): Terminated: ok {rc=0} 11:25:54.390602 --- ParallelTerminationStrategy: PID 14042 died... 11:25:54.410332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14042): Terminated: ok {rc=0} 11:25:54.456139 --- ParallelTerminationStrategy: PID 14048 died... 11:25:54.475924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14048): Terminated: ok {rc=0} 11:25:54.563759 bus /sierra_3: Setting Powered False 11:25:55.662790 bus /sierra_3: Setting Powered False 11:25:56.778602 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:25:58.033989 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:25:58.039916 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:25:58.086207 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:25:58.113165 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:25:58.165044 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:25:58.211604 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:25:58.238621 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:25:58.791266 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:25:58.797216 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:25:58.808490 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:25:58.842662 tst handover.py: using LAC 33624 11:25:58.965102 tst handover.py: using RAC 219 11:25:59.085351 tst handover.py: using CellId 33624 11:25:59.206920 tst handover.py: using BVCI 33625 11:25:59.319631 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:25:59.363667 tst handover.py: using LAC 33625 11:25:59.494174 tst handover.py: using RAC 220 11:25:59.621494 tst handover.py: using CellId 33625 11:25:59.751505 tst handover.py: using BVCI 33626 11:25:59.871563 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:25:59.883070 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:25:59.894435 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:25:59.905646 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:25:59.917112 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:25:59.928570 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:26:00.050116 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:26:00.169444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:00.649397 run create_hlr_db(pid=14054): Launched 11:26:00.773463 bus /sierra_2: Setting Powered False 11:26:01.849809 run create_hlr_db(pid=14054): Terminated: ok {rc=0} 11:26:02.317651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14056): Launched 11:26:02.644530 run osmo-hlr_10.42.42.2(pid=14057): Launched 11:26:02.770763 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:03.307727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14059): Launched 11:26:03.633209 run osmo-stp_10.42.42.5(pid=14060): Launched 11:26:03.758861 run osmo-msc_10.42.42.6: Starting osmo-msc 11:26:04.319704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14062): Launched 11:26:04.647777 run osmo-msc_10.42.42.6(pid=14063): Launched 11:26:04.830581 run osmo-stp_10.42.42.5(pid=14060): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14060)] 11:26:04.968271 run osmo-stp_10.42.42.5(pid=14060): stdout: | (launched: 2022-12-13_11:26:03.573854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:05.106983 run osmo-stp_10.42.42.5(pid=14060): stderr: | 20221213112603767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112603767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112603767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112603768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112603768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112603768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112603768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:05.244438 run osmo-stp_10.42.42.5(pid=14060): stdout: | (launched: 2022-12-13_11:26:03.573854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:05.375091 run osmo-stp_10.42.42.5(pid=14060): stderr: | 20221213112603767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112603767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112603767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112603768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112603768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112603768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112603768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:05.530656 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14060): Process ended prematurely: osmo-stp_10.42.42.5(pid=14060) [trial-2388↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14060)] [trial-2388↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 11:26:05.539487 tst handover.py:18: Test FAILED (6.7 sec) 11:26:05.566833 run osmo-hlr_10.42.42.2(pid=14057): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14057)] 11:26:05.617693 run osmo-hlr_10.42.42.2(pid=14057): stdout: | (launched: 2022-12-13_11:26:02.585202) 11:26:05.669771 run osmo-hlr_10.42.42.2(pid=14057): stderr: | 20221213112602785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112602785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112602785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112602785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112602785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112602785 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112602797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112602805 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112602805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112602806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:05.742515 run osmo-msc_10.42.42.6(pid=14063): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14063)] 11:26:05.792168 run osmo-msc_10.42.42.6(pid=14063): stdout: | (launched: 2022-12-13_11:26:04.588145) 11:26:05.844127 run osmo-msc_10.42.42.6(pid=14063): stderr: | 20221213112604911 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112604911 DLGLOBAL DEBUG validating counter group 0x7fca9750bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112604911 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112604911 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112604912 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112604912 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112604914 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112604914 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112604914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112604914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:26:05.896328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14056): Terminating (SIGTERM) 11:26:05.938194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14059): Terminating (SIGTERM) 11:26:05.980101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14062): Terminating (SIGTERM) 11:26:06.022641 --- ParallelTerminationStrategy: PID 14056 died... 11:26:06.042960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14056): Terminated: ok {rc=0} 11:26:06.089473 --- ParallelTerminationStrategy: PID 14059 died... 11:26:06.109357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14059): Terminated: ok {rc=0} 11:26:06.155686 --- ParallelTerminationStrategy: PID 14062 died... 11:26:06.175557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14062): Terminated: ok {rc=0} 11:26:06.263597 bus /sierra_3: Setting Powered False 11:26:07.361524 bus /sierra_3: Setting Powered False 11:26:08.474328 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:26:09.724641 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:26:09.730686 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:26:09.781365 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:26:09.808071 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:26:09.862941 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:26:09.914017 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:26:09.940841 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:26:10.490540 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:26:10.495797 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:26:10.507150 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:26:10.540501 tst handover.py: using LAC 33626 11:26:10.667531 tst handover.py: using RAC 221 11:26:10.794866 tst handover.py: using CellId 33626 11:26:10.921941 tst handover.py: using BVCI 33627 11:26:11.042055 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:26:11.091937 tst handover.py: using LAC 33627 11:26:11.212742 tst handover.py: using RAC 222 11:26:11.332490 tst handover.py: using CellId 33627 11:26:11.453044 tst handover.py: using BVCI 33628 11:26:11.562991 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:26:11.574151 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:26:11.585409 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:26:11.596133 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:26:11.607072 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:26:11.617944 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:26:11.738262 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:26:11.857966 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:12.335315 run create_hlr_db(pid=14068): Launched 11:26:12.460661 bus /sierra_2: Setting Powered False 11:26:13.525508 run create_hlr_db(pid=14068): Terminated: ok {rc=0} 11:26:13.951364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14070): Launched 11:26:14.277579 run osmo-hlr_10.42.42.2(pid=14071): Launched 11:26:14.405129 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:14.938452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14073): Launched 11:26:15.264492 run osmo-stp_10.42.42.5(pid=14074): Launched 11:26:15.391939 run osmo-msc_10.42.42.6: Starting osmo-msc 11:26:15.971977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14076): Launched 11:26:16.316349 run osmo-msc_10.42.42.6(pid=14077): Launched 11:26:16.607430 run osmo-stp_10.42.42.5(pid=14074): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14074)] 11:26:16.863068 run osmo-stp_10.42.42.5(pid=14074): stdout: | (launched: 2022-12-13_11:26:15.205193) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:17.114912 run osmo-stp_10.42.42.5(pid=14074): stderr: | 20221213112615398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112615398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112615398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112615399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112615401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112615401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112615401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:17.330216 run osmo-stp_10.42.42.5(pid=14074): stdout: | (launched: 2022-12-13_11:26:15.205193) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:17.461814 run osmo-stp_10.42.42.5(pid=14074): stderr: | 20221213112615398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112615398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112615398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112615399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112615401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112615401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112615401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:17.618205 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14074): Process ended prematurely: osmo-stp_10.42.42.5(pid=14074) [trial-2388↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14074)] [trial-2388↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 11:26:17.627185 tst handover.py:18: Test FAILED (7.1 sec) 11:26:17.654807 run osmo-hlr_10.42.42.2(pid=14071): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14071)] 11:26:17.706219 run osmo-hlr_10.42.42.2(pid=14071): stdout: | (launched: 2022-12-13_11:26:14.217969) 11:26:17.758439 run osmo-hlr_10.42.42.2(pid=14071): stderr: | 20221213112614419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112614419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112614419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112614419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112614419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112614419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112614431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112614439 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112614440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112614440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:17.832030 run osmo-msc_10.42.42.6(pid=14077): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14077)] 11:26:17.882465 run osmo-msc_10.42.42.6(pid=14077): stdout: | (launched: 2022-12-13_11:26:16.255957) 11:26:17.934576 run osmo-msc_10.42.42.6(pid=14077): stderr: | 20221213112616809 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112616809 DLGLOBAL DEBUG validating counter group 0x7f40c469cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112616809 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112616809 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112616810 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112616810 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112616811 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112616812 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112616812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112616812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:26:17.987205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14070): Terminating (SIGTERM) 11:26:18.029402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14073): Terminating (SIGTERM) 11:26:18.071593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14076): Terminating (SIGTERM) 11:26:18.114260 --- ParallelTerminationStrategy: PID 14070 died... 11:26:18.134865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14070): Terminated: ok {rc=0} 11:26:18.181757 --- ParallelTerminationStrategy: PID 14073 died... 11:26:18.202145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14073): Terminated: ok {rc=0} 11:26:18.248718 --- ParallelTerminationStrategy: PID 14076 died... 11:26:18.269252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14076): Terminated: ok {rc=0} 11:26:18.358457 bus /sierra_3: Setting Powered False 11:26:19.457073 bus /sierra_3: Setting Powered False 11:26:20.573275 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 11:26:21.834922 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:26:21.840299 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:26:21.878533 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:26:21.905914 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:26:21.958941 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:26:21.995641 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:26:22.022603 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:26:22.572718 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 11:26:22.578636 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:26:22.590093 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 11:26:22.622415 tst handover.py: using LAC 33628 11:26:22.741145 tst handover.py: using RAC 223 11:26:22.860297 tst handover.py: using CellId 33628 11:26:22.977712 tst handover.py: using BVCI 33629 11:26:23.098416 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 11:26:23.131906 tst handover.py: using LAC 33629 11:26:23.258886 tst handover.py: using RAC 224 11:26:23.384858 tst handover.py: using CellId 33629 11:26:23.510231 tst handover.py: using BVCI 33630 11:26:23.628803 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:26:23.639978 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:26:23.651025 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:26:23.662013 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:26:23.673827 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:26:23.685129 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 11:26:23.803653 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 11:26:23.919181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:24.366364 run create_hlr_db(pid=14082): Launched 11:26:24.492507 bus /sierra_2: Setting Powered False 11:26:25.554014 run create_hlr_db(pid=14082): Terminated: ok {rc=0} 11:26:25.952753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14084): Launched 11:26:26.256786 run osmo-hlr_10.42.42.2(pid=14085): Launched 11:26:26.372302 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:26.873686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14087): Launched 11:26:27.175972 run osmo-stp_10.42.42.5(pid=14088): Launched 11:26:27.291152 run osmo-msc_10.42.42.6: Starting osmo-msc 11:26:27.813595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14090): Launched 11:26:28.117354 run osmo-msc_10.42.42.6(pid=14091): Launched 11:26:28.288324 run osmo-stp_10.42.42.5(pid=14088): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14088)] 11:26:28.417416 run osmo-stp_10.42.42.5(pid=14088): stdout: | (launched: 2022-12-13_11:26:27.120623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:28.546086 run osmo-stp_10.42.42.5(pid=14088): stderr: | 20221213112627291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112627291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112627291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112627291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112627294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112627294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112627294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:28.672560 run osmo-stp_10.42.42.5(pid=14088): stdout: | (launched: 2022-12-13_11:26:27.120623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:28.794076 run osmo-stp_10.42.42.5(pid=14088): stderr: | 20221213112627291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112627291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112627291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112627291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112627294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112627294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112627294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:28.939926 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14088): Process ended prematurely: osmo-stp_10.42.42.5(pid=14088) [trial-2388↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14088)] [trial-2388↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 11:26:28.948212 tst handover.py:18: Test FAILED (6.4 sec) 11:26:28.974124 run osmo-hlr_10.42.42.2(pid=14085): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14085)] 11:26:29.021691 run osmo-hlr_10.42.42.2(pid=14085): stdout: | (launched: 2022-12-13_11:26:26.200812) 11:26:29.071213 run osmo-hlr_10.42.42.2(pid=14085): stderr: | 20221213112626378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112626378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112626378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112626378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112626378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112626378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112626390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112626400 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112626400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112626400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:29.140777 run osmo-msc_10.42.42.6(pid=14091): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14091)] 11:26:29.188261 run osmo-msc_10.42.42.6(pid=14091): stdout: | (launched: 2022-12-13_11:26:28.061600) 11:26:29.237301 run osmo-msc_10.42.42.6(pid=14091): stderr: | 20221213112628335 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112628335 DLGLOBAL DEBUG validating counter group 0x7f9449b0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112628335 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112628335 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112628335 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112628336 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112628337 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112628338 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112628338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112628338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:26:29.286838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14084): Terminating (SIGTERM) 11:26:29.326328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14087): Terminating (SIGTERM) 11:26:29.365924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14090): Terminating (SIGTERM) 11:26:29.405662 --- ParallelTerminationStrategy: PID 14084 died... 11:26:29.424743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14084): Terminated: ok {rc=0} 11:26:29.468726 --- ParallelTerminationStrategy: PID 14087 died... 11:26:29.487324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14087): Terminated: ok {rc=0} 11:26:29.531030 --- ParallelTerminationStrategy: PID 14090 died... 11:26:29.549693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14090): Terminated: ok {rc=0} 11:26:29.632560 bus /sierra_3: Setting Powered False 11:26:30.730296 bus /sierra_3: Setting Powered False 11:26:31.860147 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 11:26:33.113726 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:26:33.118646 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:26:33.166488 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:26:33.192853 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:26:33.243446 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:26:33.291242 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:26:33.317237 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:26:33.867814 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 11:26:33.872810 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:26:33.883545 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:26:33.916056 tst handover.py: using LAC 33630 11:26:34.036079 tst handover.py: using RAC 225 11:26:34.166534 tst handover.py: using CellId 33630 11:26:34.296150 tst handover.py: using BVCI 33631 11:26:34.414931 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:26:34.463702 tst handover.py: using LAC 33631 11:26:34.592483 tst handover.py: using RAC 226 11:26:34.721377 tst handover.py: using CellId 33631 11:26:34.849982 tst handover.py: using BVCI 33632 11:26:34.969986 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:26:34.981214 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:26:34.992150 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:26:35.003263 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:26:35.014647 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:26:35.025977 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:26:35.143165 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:26:35.263396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:35.742734 run create_hlr_db(pid=14096): Launched 11:26:35.866700 bus /sierra_2: Setting Powered False 11:26:36.931153 run create_hlr_db(pid=14096): Terminated: ok {rc=0} 11:26:37.341382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14098): Launched 11:26:37.646884 run osmo-hlr_10.42.42.2(pid=14099): Launched 11:26:37.764005 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:38.262740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14101): Launched 11:26:38.565904 run osmo-stp_10.42.42.5(pid=14102): Launched 11:26:38.682061 run osmo-msc_10.42.42.6: Starting osmo-msc 11:26:39.205620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14104): Launched 11:26:39.509489 run osmo-msc_10.42.42.6(pid=14105): Launched 11:26:39.679410 run osmo-stp_10.42.42.5(pid=14102): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14102)] 11:26:39.807897 run osmo-stp_10.42.42.5(pid=14102): stdout: | (launched: 2022-12-13_11:26:38.510169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:39.937097 run osmo-stp_10.42.42.5(pid=14102): stderr: | 20221213112638682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112638682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112638683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112638683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112638683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112638683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112638684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:40.063509 run osmo-stp_10.42.42.5(pid=14102): stdout: | (launched: 2022-12-13_11:26:38.510169) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:40.183902 run osmo-stp_10.42.42.5(pid=14102): stderr: | 20221213112638682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112638682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112638683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112638683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112638683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112638683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112638684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:40.328526 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14102): Process ended prematurely: osmo-stp_10.42.42.5(pid=14102) [trial-2388↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14102)] [trial-2388↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 11:26:40.336809 tst handover.py:18: Test FAILED (6.5 sec) 11:26:40.362891 run osmo-hlr_10.42.42.2(pid=14099): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14099)] 11:26:40.411051 run osmo-hlr_10.42.42.2(pid=14099): stdout: | (launched: 2022-12-13_11:26:37.591159) 11:26:40.460499 run osmo-hlr_10.42.42.2(pid=14099): stderr: | 20221213112637766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112637766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112637766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112637766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112637766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112637766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112637779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112637788 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112637788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112637789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:40.529443 run osmo-msc_10.42.42.6(pid=14105): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14105)] 11:26:40.577284 run osmo-msc_10.42.42.6(pid=14105): stdout: | (launched: 2022-12-13_11:26:39.453945) 11:26:40.626460 run osmo-msc_10.42.42.6(pid=14105): stderr: | 20221213112639725 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112639726 DLGLOBAL DEBUG validating counter group 0x7fcf47d36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112639726 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112639726 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112639726 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112639726 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112639728 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112639728 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112639728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112639728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:26:40.676078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14098): Terminating (SIGTERM) 11:26:40.715416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14101): Terminating (SIGTERM) 11:26:40.755037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14104): Terminating (SIGTERM) 11:26:40.794835 --- ParallelTerminationStrategy: PID 14098 died... 11:26:40.813936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14098): Terminated: ok {rc=0} 11:26:40.857743 --- ParallelTerminationStrategy: PID 14101 died... 11:26:40.876172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14101): Terminated: ok {rc=0} 11:26:40.920164 --- ParallelTerminationStrategy: PID 14104 died... 11:26:40.938807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14104): Terminated: ok {rc=0} 11:26:41.024315 bus /sierra_3: Setting Powered False 11:26:42.123292 bus /sierra_3: Setting Powered False 11:26:43.238272 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 11:26:44.494246 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:26:44.499658 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:26:44.549865 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:26:44.576767 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:26:44.629085 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:26:44.677556 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:26:44.703728 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:26:45.256481 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 11:26:45.262701 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:26:45.274419 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:26:45.308888 tst handover.py: using LAC 33632 11:26:45.440605 tst handover.py: using RAC 227 11:26:45.567830 tst handover.py: using CellId 33632 11:26:45.695302 tst handover.py: using BVCI 33633 11:26:45.815528 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:26:45.862171 tst handover.py: using LAC 33633 11:26:46.017267 tst handover.py: using RAC 228 11:26:46.176266 tst handover.py: using CellId 33633 11:26:46.339980 tst handover.py: using BVCI 33634 11:26:46.460926 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:26:46.472791 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:26:46.484656 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:26:46.496434 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:26:46.508534 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:26:46.520380 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:26:46.645634 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:26:46.789513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:47.313879 run create_hlr_db(pid=14110): Launched 11:26:47.470576 bus /sierra_2: Setting Powered False 11:26:48.535349 run create_hlr_db(pid=14110): Terminated: ok {rc=0} 11:26:48.945673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14112): Launched 11:26:49.251641 run osmo-hlr_10.42.42.2(pid=14113): Launched 11:26:49.368296 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:49.867450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14115): Launched 11:26:50.172810 run osmo-stp_10.42.42.5(pid=14116): Launched 11:26:50.289183 run osmo-msc_10.42.42.6: Starting osmo-msc 11:26:50.815649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14118): Launched 11:26:51.120907 run osmo-msc_10.42.42.6(pid=14119): Launched 11:26:51.291232 run osmo-stp_10.42.42.5(pid=14116): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14116)] 11:26:51.420631 run osmo-stp_10.42.42.5(pid=14116): stdout: | (launched: 2022-12-13_11:26:50.117176) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:51.549237 run osmo-stp_10.42.42.5(pid=14116): stderr: | 20221213112650289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112650289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112650289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112650290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112650290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112650290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112650290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:51.676155 run osmo-stp_10.42.42.5(pid=14116): stdout: | (launched: 2022-12-13_11:26:50.117176) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:51.797719 run osmo-stp_10.42.42.5(pid=14116): stderr: | 20221213112650289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112650289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112650289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112650290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112650290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112650290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112650290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:51.943105 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14116): Process ended prematurely: osmo-stp_10.42.42.5(pid=14116) [trial-2388↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14116)] [trial-2388↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 11:26:51.951297 tst handover.py:18: Test FAILED (6.7 sec) 11:26:51.976935 run osmo-hlr_10.42.42.2(pid=14113): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14113)] 11:26:52.024125 run osmo-hlr_10.42.42.2(pid=14113): stdout: | (launched: 2022-12-13_11:26:49.195436) 11:26:52.073325 run osmo-hlr_10.42.42.2(pid=14113): stderr: | 20221213112649371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112649371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112649371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112649371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112649371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112649371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112649384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112649393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112649393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112649393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:52.141586 run osmo-msc_10.42.42.6(pid=14119): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14119)] 11:26:52.188785 run osmo-msc_10.42.42.6(pid=14119): stdout: | (launched: 2022-12-13_11:26:51.065221) 11:26:52.237614 run osmo-msc_10.42.42.6(pid=14119): stderr: | 20221213112651336 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112651336 DLGLOBAL DEBUG validating counter group 0x7f10291f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112651337 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112651337 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112651337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112651337 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112651339 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112651339 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112651339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112651339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:26:52.286742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14112): Terminating (SIGTERM) 11:26:52.326253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14115): Terminating (SIGTERM) 11:26:52.365583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14118): Terminating (SIGTERM) 11:26:52.405197 --- ParallelTerminationStrategy: PID 14112 died... 11:26:52.424027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14112): Terminated: ok {rc=0} 11:26:52.467355 --- ParallelTerminationStrategy: PID 14115 died... 11:26:52.485686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14115): Terminated: ok {rc=0} 11:26:52.529222 --- ParallelTerminationStrategy: PID 14118 died... 11:26:52.547580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14118): Terminated: ok {rc=0} 11:26:52.633232 bus /sierra_3: Setting Powered False 11:26:53.732531 bus /sierra_3: Setting Powered False 11:26:54.848284 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:26:56.110432 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:26:56.116169 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:26:56.176365 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:26:56.203285 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:26:56.254006 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:26:56.314067 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:26:56.341087 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:26:56.894775 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:26:56.900270 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:26:56.911662 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:26:56.964423 tst handover.py: using LAC 33634 11:26:57.090716 tst handover.py: using RAC 229 11:26:57.217150 tst handover.py: using CellId 33634 11:26:57.343556 tst handover.py: using BVCI 33635 11:26:57.461686 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:26:57.505437 tst handover.py: using LAC 33635 11:26:57.632868 tst handover.py: using RAC 230 11:26:57.758646 tst handover.py: using CellId 33635 11:26:57.884644 tst handover.py: using BVCI 33636 11:26:58.003193 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:26:58.015028 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:26:58.026294 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:26:58.037684 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:26:58.049248 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:26:58.060684 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:26:58.178586 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:26:58.294329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:58.739312 run create_hlr_db(pid=14124): Launched 11:26:58.867703 bus /sierra_2: Setting Powered False 11:26:59.931558 run create_hlr_db(pid=14124): Terminated: ok {rc=0} 11:27:00.341120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14126): Launched 11:27:00.646641 run osmo-hlr_10.42.42.2(pid=14127): Launched 11:27:00.764232 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:01.415809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14129): Launched 11:27:01.764783 run osmo-stp_10.42.42.5(pid=14130): Launched 11:27:02.016164 run osmo-msc_10.42.42.6: Starting osmo-msc 11:27:02.660020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14132): Launched 11:27:02.986798 run osmo-msc_10.42.42.6(pid=14133): Launched 11:27:03.203262 run osmo-stp_10.42.42.5(pid=14130): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14130)] 11:27:03.374408 run osmo-stp_10.42.42.5(pid=14130): stdout: | (launched: 2022-12-13_11:27:01.703637) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:03.513293 run osmo-stp_10.42.42.5(pid=14130): stderr: | 20221213112701997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112701997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112701997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112701997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112701998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112701998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112701998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:03.649964 run osmo-stp_10.42.42.5(pid=14130): stdout: | (launched: 2022-12-13_11:27:01.703637) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:03.780620 run osmo-stp_10.42.42.5(pid=14130): stderr: | 20221213112701997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112701997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112701997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112701997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112701998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112701998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112701998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:03.936371 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14130): Process ended prematurely: osmo-stp_10.42.42.5(pid=14130) [trial-2388↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14130)] [trial-2388↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 11:27:03.945558 tst handover.py:18: Test FAILED (7.0 sec) 11:27:03.972859 run osmo-hlr_10.42.42.2(pid=14127): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14127)] 11:27:04.023581 run osmo-hlr_10.42.42.2(pid=14127): stdout: | (launched: 2022-12-13_11:27:00.590490) 11:27:04.075607 run osmo-hlr_10.42.42.2(pid=14127): stderr: | 20221213112700765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112700765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112700765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112700765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112700766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112700766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112700779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112700787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112700788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112700788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:04.148622 run osmo-msc_10.42.42.6(pid=14133): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14133)] 11:27:04.198776 run osmo-msc_10.42.42.6(pid=14133): stdout: | (launched: 2022-12-13_11:27:02.927602) 11:27:04.250757 run osmo-msc_10.42.42.6(pid=14133): stderr: | 20221213112703250 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112703250 DLGLOBAL DEBUG validating counter group 0x7fbe29ae4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112703250 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112703250 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112703250 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112703250 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112703252 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112703253 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112703253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112703253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:27:04.303871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14126): Terminating (SIGTERM) 11:27:04.346148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14129): Terminating (SIGTERM) 11:27:04.388720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14132): Terminating (SIGTERM) 11:27:04.431563 --- ParallelTerminationStrategy: PID 14126 died... 11:27:04.452109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14126): Terminated: ok {rc=0} 11:27:04.498939 --- ParallelTerminationStrategy: PID 14129 died... 11:27:04.518887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14129): Terminated: ok {rc=0} 11:27:04.565677 --- ParallelTerminationStrategy: PID 14132 died... 11:27:04.585947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14132): Terminated: ok {rc=0} 11:27:04.674923 bus /sierra_3: Setting Powered False 11:27:05.774429 bus /sierra_3: Setting Powered False 11:27:06.893246 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:27:08.157448 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:27:08.162530 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:27:08.224618 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:27:08.250755 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:27:08.301724 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:27:08.367911 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:27:08.395215 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:27:08.948835 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:27:08.954642 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:27:08.966153 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:27:09.016538 tst handover.py: using LAC 33636 11:27:09.136230 tst handover.py: using RAC 231 11:27:09.259393 tst handover.py: using CellId 33636 11:27:09.378527 tst handover.py: using BVCI 33637 11:27:09.488463 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:27:09.540068 tst handover.py: using LAC 33637 11:27:09.658333 tst handover.py: using RAC 232 11:27:09.778332 tst handover.py: using CellId 33637 11:27:09.898022 tst handover.py: using BVCI 33638 11:27:10.017836 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:27:10.029422 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:27:10.040836 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:27:10.052272 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:27:10.064145 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:27:10.075866 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:27:10.193870 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:27:10.310073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:10.756423 run create_hlr_db(pid=14138): Launched 11:27:10.881333 bus /sierra_2: Setting Powered False 11:27:11.945305 run create_hlr_db(pid=14138): Terminated: ok {rc=0} 11:27:12.372255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14140): Launched 11:27:12.697605 run osmo-hlr_10.42.42.2(pid=14141): Launched 11:27:12.822651 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:13.357202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14143): Launched 11:27:13.683002 run osmo-stp_10.42.42.5(pid=14144): Launched 11:27:13.807719 run osmo-msc_10.42.42.6: Starting osmo-msc 11:27:14.369273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14146): Launched 11:27:14.697356 run osmo-msc_10.42.42.6(pid=14147): Launched 11:27:14.881511 run osmo-stp_10.42.42.5(pid=14144): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14144)] 11:27:15.019430 run osmo-stp_10.42.42.5(pid=14144): stdout: | (launched: 2022-12-13_11:27:13.623756) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:15.157840 run osmo-stp_10.42.42.5(pid=14144): stderr: | 20221213112713818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112713819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112713819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112713819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112713820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112713820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112713820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:15.295970 run osmo-stp_10.42.42.5(pid=14144): stdout: | (launched: 2022-12-13_11:27:13.623756) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:15.427087 run osmo-stp_10.42.42.5(pid=14144): stderr: | 20221213112713818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112713819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112713819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112713819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112713820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112713820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112713820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:15.583325 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14144): Process ended prematurely: osmo-stp_10.42.42.5(pid=14144) [trial-2388↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14144)] [trial-2388↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 11:27:15.592321 tst handover.py:18: Test FAILED (6.6 sec) 11:27:15.619929 run osmo-hlr_10.42.42.2(pid=14141): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14141)] 11:27:15.670854 run osmo-hlr_10.42.42.2(pid=14141): stdout: | (launched: 2022-12-13_11:27:12.638164) 11:27:15.722869 run osmo-hlr_10.42.42.2(pid=14141): stderr: | 20221213112712837 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112712837 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112712837 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112712837 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112712837 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112712837 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112712850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112712858 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112712858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112712859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:15.795746 run osmo-msc_10.42.42.6(pid=14147): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14147)] 11:27:15.845786 run osmo-msc_10.42.42.6(pid=14147): stdout: | (launched: 2022-12-13_11:27:14.638080) 11:27:15.909046 run osmo-msc_10.42.42.6(pid=14147): stderr: | 20221213112714963 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112714963 DLGLOBAL DEBUG validating counter group 0x7fc8e2d3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112714964 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112714964 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112714964 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112714964 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112714966 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112714966 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112714966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112714966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:27:15.966504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14140): Terminating (SIGTERM) 11:27:16.009197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14143): Terminating (SIGTERM) 11:27:16.052284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14146): Terminating (SIGTERM) 11:27:16.095460 --- ParallelTerminationStrategy: PID 14140 died... 11:27:16.116052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14140): Terminated: ok {rc=0} 11:27:16.163926 --- ParallelTerminationStrategy: PID 14143 died... 11:27:16.184771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14143): Terminated: ok {rc=0} 11:27:16.232424 --- ParallelTerminationStrategy: PID 14146 died... 11:27:16.253142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14146): Terminated: ok {rc=0} 11:27:16.343963 bus /sierra_3: Setting Powered False 11:27:17.443634 bus /sierra_3: Setting Powered False 11:27:18.560604 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 11:27:19.837110 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:27:19.842751 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:27:19.895324 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:27:19.922295 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:27:19.975453 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:27:20.028044 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:27:20.055073 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:27:20.603240 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 11:27:20.608870 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:27:20.620248 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 11:27:20.670847 tst handover.py: using LAC 33638 11:27:20.791605 tst handover.py: using RAC 233 11:27:20.913917 tst handover.py: using CellId 33638 11:27:21.035742 tst handover.py: using BVCI 33639 11:27:21.148353 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 11:27:21.183142 tst handover.py: using LAC 33639 11:27:21.304518 tst handover.py: using RAC 234 11:27:21.425131 tst handover.py: using CellId 33639 11:27:21.544531 tst handover.py: using BVCI 33640 11:27:21.654738 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:27:21.665461 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:27:21.675908 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:27:21.686347 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:27:21.696788 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:27:21.707728 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 11:27:21.829560 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 11:27:21.947222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:22.393845 run create_hlr_db(pid=14152): Launched 11:27:22.517264 bus /sierra_2: Setting Powered False 11:27:23.577643 run create_hlr_db(pid=14152): Terminated: ok {rc=0} 11:27:23.994057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14154): Launched 11:27:24.321407 run osmo-hlr_10.42.42.2(pid=14155): Launched 11:27:24.448883 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:24.982268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14157): Launched 11:27:25.310031 run osmo-stp_10.42.42.5(pid=14158): Launched 11:27:25.436695 run osmo-msc_10.42.42.6: Starting osmo-msc 11:27:25.998578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14160): Launched 11:27:26.326552 run osmo-msc_10.42.42.6(pid=14161): Launched 11:27:26.508857 run osmo-stp_10.42.42.5(pid=14158): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14158)] 11:27:26.647228 run osmo-stp_10.42.42.5(pid=14158): stdout: | (launched: 2022-12-13_11:27:25.250437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:26.786663 run osmo-stp_10.42.42.5(pid=14158): stderr: | 20221213112725443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112725443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112725443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112725444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112725444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112725444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112725444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:26.924445 run osmo-stp_10.42.42.5(pid=14158): stdout: | (launched: 2022-12-13_11:27:25.250437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:27.055191 run osmo-stp_10.42.42.5(pid=14158): stderr: | 20221213112725443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112725443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112725443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112725444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112725444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112725444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112725444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:27.211103 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14158): Process ended prematurely: osmo-stp_10.42.42.5(pid=14158) [trial-2388↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14158)] [trial-2388↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 11:27:27.220197 tst handover.py:18: Test FAILED (6.6 sec) 11:27:27.247873 run osmo-hlr_10.42.42.2(pid=14155): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14155)] 11:27:27.299647 run osmo-hlr_10.42.42.2(pid=14155): stdout: | (launched: 2022-12-13_11:27:24.262023) 11:27:27.352253 run osmo-hlr_10.42.42.2(pid=14155): stderr: | 20221213112724459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112724459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112724459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112724459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112724459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112724459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112724472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112724481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112724481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112724481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:27.425550 run osmo-msc_10.42.42.6(pid=14161): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14161)] 11:27:27.475482 run osmo-msc_10.42.42.6(pid=14161): stdout: | (launched: 2022-12-13_11:27:26.266846) 11:27:27.527734 run osmo-msc_10.42.42.6(pid=14161): stderr: | 20221213112726590 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112726590 DLGLOBAL DEBUG validating counter group 0x7efce2a97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112726590 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112726590 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112726590 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112726590 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112726594 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112726594 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112726594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112726595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:27:27.580674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14154): Terminating (SIGTERM) 11:27:27.622975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14157): Terminating (SIGTERM) 11:27:27.665956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14160): Terminating (SIGTERM) 11:27:27.708775 --- ParallelTerminationStrategy: PID 14154 died... 11:27:27.729561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14154): Terminated: ok {rc=0} 11:27:27.776361 --- ParallelTerminationStrategy: PID 14157 died... 11:27:27.796627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14157): Terminated: ok {rc=0} 11:27:27.843275 --- ParallelTerminationStrategy: PID 14160 died... 11:27:27.863461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14160): Terminated: ok {rc=0} 11:27:27.951971 bus /sierra_3: Setting Powered False 11:27:29.050385 bus /sierra_3: Setting Powered False 11:27:30.166623 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 11:27:31.425293 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:27:31.431432 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:27:31.499384 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:27:31.528097 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:27:31.582891 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:27:31.654054 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:27:31.682250 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:27:32.249082 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 11:27:32.256254 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:27:32.268803 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:27:32.321294 tst handover.py: using LAC 33640 11:27:32.441821 tst handover.py: using RAC 235 11:27:32.560630 tst handover.py: using CellId 33640 11:27:32.689154 tst handover.py: using BVCI 33641 11:27:32.809751 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:27:32.858832 tst handover.py: using LAC 33641 11:27:32.988168 tst handover.py: using RAC 236 11:27:33.115285 tst handover.py: using CellId 33641 11:27:33.243524 tst handover.py: using BVCI 33642 11:27:33.364642 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:27:33.376032 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:27:33.387234 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:27:33.398614 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:27:33.410402 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:27:33.422070 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:27:33.539866 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:27:33.660090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:34.138481 run create_hlr_db(pid=14166): Launched 11:27:34.262927 bus /sierra_2: Setting Powered False 11:27:35.328093 run create_hlr_db(pid=14166): Terminated: ok {rc=0} 11:27:35.754930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14168): Launched 11:27:36.081423 run osmo-hlr_10.42.42.2(pid=14169): Launched 11:27:36.205896 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:36.738789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14171): Launched 11:27:37.066680 run osmo-stp_10.42.42.5(pid=14172): Launched 11:27:37.191697 run osmo-msc_10.42.42.6: Starting osmo-msc 11:27:37.759021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14174): Launched 11:27:38.070074 run osmo-msc_10.42.42.6(pid=14175): Launched 11:27:38.244182 run osmo-stp_10.42.42.5(pid=14172): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14172)] 11:27:38.373920 run osmo-stp_10.42.42.5(pid=14172): stdout: | (launched: 2022-12-13_11:27:37.007263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:38.502858 run osmo-stp_10.42.42.5(pid=14172): stderr: | 20221213112737199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112737199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112737199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112737200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112737202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112737202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112737202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:38.630793 run osmo-stp_10.42.42.5(pid=14172): stdout: | (launched: 2022-12-13_11:27:37.007263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:38.752200 run osmo-stp_10.42.42.5(pid=14172): stderr: | 20221213112737199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112737199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112737199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112737200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112737202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112737202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112737202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:38.898425 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14172): Process ended prematurely: osmo-stp_10.42.42.5(pid=14172) [trial-2388↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14172)] [trial-2388↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 11:27:38.906632 tst handover.py:18: Test FAILED (6.6 sec) 11:27:38.932470 run osmo-hlr_10.42.42.2(pid=14169): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14169)] 11:27:38.979976 run osmo-hlr_10.42.42.2(pid=14169): stdout: | (launched: 2022-12-13_11:27:36.021913) 11:27:39.028773 run osmo-hlr_10.42.42.2(pid=14169): stderr: | 20221213112736222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112736222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112736222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112736222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112736222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112736222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112736234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112736242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112736242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112736242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:39.097019 run osmo-msc_10.42.42.6(pid=14175): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14175)] 11:27:39.144562 run osmo-msc_10.42.42.6(pid=14175): stdout: | (launched: 2022-12-13_11:27:38.014415) 11:27:39.193523 run osmo-msc_10.42.42.6(pid=14175): stderr: | 20221213112738288 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112738288 DLGLOBAL DEBUG validating counter group 0x7f8eed3c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112738288 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112738288 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112738288 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112738288 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112738290 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112738291 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112738291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112738291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:27:39.243063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14168): Terminating (SIGTERM) 11:27:39.282286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14171): Terminating (SIGTERM) 11:27:39.321811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14174): Terminating (SIGTERM) 11:27:39.361568 --- ParallelTerminationStrategy: PID 14168 died... 11:27:39.381003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14168): Terminated: ok {rc=0} 11:27:39.425043 --- ParallelTerminationStrategy: PID 14171 died... 11:27:39.443583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14171): Terminated: ok {rc=0} 11:27:39.487096 --- ParallelTerminationStrategy: PID 14174 died... 11:27:39.505728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14174): Terminated: ok {rc=0} 11:27:39.592033 bus /sierra_3: Setting Powered False 11:27:40.692783 bus /sierra_3: Setting Powered False 11:27:41.808481 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 11:27:43.076464 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:27:43.082106 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:27:43.142667 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:27:43.168680 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:27:43.220737 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:27:43.284623 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:27:43.312135 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:27:43.856356 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 11:27:43.861467 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:27:43.872149 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:27:43.921765 tst handover.py: using LAC 33642 11:27:44.051651 tst handover.py: using RAC 237 11:27:44.178128 tst handover.py: using CellId 33642 11:27:44.303463 tst handover.py: using BVCI 33643 11:27:44.423876 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:27:44.471461 tst handover.py: using LAC 33643 11:27:44.597645 tst handover.py: using RAC 238 11:27:44.717760 tst handover.py: using CellId 33643 11:27:44.837571 tst handover.py: using BVCI 33644 11:27:44.950282 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:27:44.961037 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:27:44.971566 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:27:44.982145 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:27:44.992636 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:27:45.003635 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:27:45.123894 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:27:45.240096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:45.686634 run create_hlr_db(pid=14180): Launched 11:27:45.810995 bus /sierra_2: Setting Powered False 11:27:46.878339 run create_hlr_db(pid=14180): Terminated: ok {rc=0} 11:27:47.289478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14182): Launched 11:27:47.617792 run osmo-hlr_10.42.42.2(pid=14183): Launched 11:27:47.742002 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:48.276067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14185): Launched 11:27:48.603713 run osmo-stp_10.42.42.5(pid=14186): Launched 11:27:48.729399 run osmo-msc_10.42.42.6: Starting osmo-msc 11:27:49.291054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14188): Launched 11:27:49.619922 run osmo-msc_10.42.42.6(pid=14189): Launched 11:27:49.802567 run osmo-stp_10.42.42.5(pid=14186): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14186)] 11:27:49.940426 run osmo-stp_10.42.42.5(pid=14186): stdout: | (launched: 2022-12-13_11:27:48.543501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:50.079200 run osmo-stp_10.42.42.5(pid=14186): stderr: | 20221213112748737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112748738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112748738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112748738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112748739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112748739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112748739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:50.217182 run osmo-stp_10.42.42.5(pid=14186): stdout: | (launched: 2022-12-13_11:27:48.543501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:50.348183 run osmo-stp_10.42.42.5(pid=14186): stderr: | 20221213112748737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112748738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112748738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112748738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112748739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112748739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112748739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:50.504431 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14186): Process ended prematurely: osmo-stp_10.42.42.5(pid=14186) [trial-2388↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14186)] [trial-2388↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 11:27:50.513615 tst handover.py:18: Test FAILED (6.6 sec) 11:27:50.541198 run osmo-hlr_10.42.42.2(pid=14183): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14183)] 11:27:50.592664 run osmo-hlr_10.42.42.2(pid=14183): stdout: | (launched: 2022-12-13_11:27:47.558408) 11:27:50.645438 run osmo-hlr_10.42.42.2(pid=14183): stderr: | 20221213112747756 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112747756 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112747756 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112747756 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112747756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112747756 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112747768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112747776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112747777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112747777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:50.717992 run osmo-msc_10.42.42.6(pid=14189): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14189)] 11:27:50.768033 run osmo-msc_10.42.42.6(pid=14189): stdout: | (launched: 2022-12-13_11:27:49.560186) 11:27:50.820258 run osmo-msc_10.42.42.6(pid=14189): stderr: | 20221213112749883 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112749883 DLGLOBAL DEBUG validating counter group 0x7f553d9a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112749883 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112749883 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112749883 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112749884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112749885 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112749886 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112749886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112749886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:27:50.872553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14182): Terminating (SIGTERM) 11:27:50.914692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14185): Terminating (SIGTERM) 11:27:50.956586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14188): Terminating (SIGTERM) 11:27:50.999098 --- ParallelTerminationStrategy: PID 14182 died... 11:27:51.019685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14182): Terminated: ok {rc=0} 11:27:51.066256 --- ParallelTerminationStrategy: PID 14185 died... 11:27:51.086326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14185): Terminated: ok {rc=0} 11:27:51.132595 --- ParallelTerminationStrategy: PID 14188 died... 11:27:51.152635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14188): Terminated: ok {rc=0} 11:27:51.240717 bus /sierra_3: Setting Powered False 11:27:52.339993 bus /sierra_3: Setting Powered False 11:27:53.457385 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:27:54.724567 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:27:54.729536 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:27:54.787798 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:27:54.813901 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:27:54.865851 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:27:54.927164 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:27:54.954676 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:27:55.502411 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:27:55.507624 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:27:55.518958 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:27:55.562065 tst handover.py: using LAC 33644 11:27:55.691511 tst handover.py: using RAC 239 11:27:55.818542 tst handover.py: using CellId 33644 11:27:55.945802 tst handover.py: using BVCI 33645 11:27:56.064078 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:27:56.114724 tst handover.py: using LAC 33645 11:27:56.236531 tst handover.py: using RAC 240 11:27:56.357473 tst handover.py: using CellId 33645 11:27:56.477499 tst handover.py: using BVCI 33646 11:27:56.588877 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:27:56.600362 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:27:56.611289 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:27:56.622229 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:27:56.633668 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:27:56.645244 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:27:56.766562 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:27:56.887224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:57.366875 run create_hlr_db(pid=14194): Launched 11:27:57.492715 bus /sierra_2: Setting Powered False 11:27:58.557595 run create_hlr_db(pid=14194): Terminated: ok {rc=0} 11:27:58.983763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14196): Launched 11:27:59.290226 run osmo-hlr_10.42.42.2(pid=14197): Launched 11:27:59.407268 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:59.921940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14199): Launched 11:28:00.226665 run osmo-stp_10.42.42.5(pid=14200): Launched 11:28:00.344651 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:00.879317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14202): Launched 11:28:01.225734 run osmo-msc_10.42.42.6(pid=14203): Launched 11:28:01.528402 run osmo-stp_10.42.42.5(pid=14200): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14200)] 11:28:01.759571 run osmo-stp_10.42.42.5(pid=14200): stdout: | (launched: 2022-12-13_11:28:00.171148) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:02.069486 run osmo-stp_10.42.42.5(pid=14200): stderr: | 20221213112800341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112800341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112800342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112800342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112800342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112800342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112800343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:02.199465 run osmo-stp_10.42.42.5(pid=14200): stdout: | (launched: 2022-12-13_11:28:00.171148) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:02.323193 run osmo-stp_10.42.42.5(pid=14200): stderr: | 20221213112800341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112800341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112800342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112800342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112800342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112800342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112800343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:02.469391 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14200): Process ended prematurely: osmo-stp_10.42.42.5(pid=14200) [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14200)] [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 11:28:02.477536 tst handover.py:18: Test FAILED (7.0 sec) 11:28:02.503687 run osmo-hlr_10.42.42.2(pid=14197): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14197)] 11:28:02.551720 run osmo-hlr_10.42.42.2(pid=14197): stdout: | (launched: 2022-12-13_11:27:59.234443) 11:28:02.601363 run osmo-hlr_10.42.42.2(pid=14197): stderr: | 20221213112759410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112759411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112759411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112759411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112759411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112759411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112759423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112759432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112759432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112759432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:02.671087 run osmo-msc_10.42.42.6(pid=14203): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14203)] 11:28:02.718828 run osmo-msc_10.42.42.6(pid=14203): stdout: | (launched: 2022-12-13_11:28:01.159712) 11:28:02.768530 run osmo-msc_10.42.42.6(pid=14203): stderr: | 20221213112801764 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112801764 DLGLOBAL DEBUG validating counter group 0x7fac0cfc4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112801764 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112801764 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112801764 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112801764 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112801766 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112801766 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112801767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112801767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:02.818447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14196): Terminating (SIGTERM) 11:28:02.858468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14199): Terminating (SIGTERM) 11:28:02.898323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14202): Terminating (SIGTERM) 11:28:02.938618 --- ParallelTerminationStrategy: PID 14196 died... 11:28:02.957959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14196): Terminated: ok {rc=0} 11:28:03.002531 --- ParallelTerminationStrategy: PID 14199 died... 11:28:03.021489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14199): Terminated: ok {rc=0} 11:28:03.065903 --- ParallelTerminationStrategy: PID 14202 died... 11:28:03.084611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14202): Terminated: ok {rc=0} 11:28:03.171287 bus /sierra_3: Setting Powered False 11:28:04.271591 bus /sierra_3: Setting Powered False 11:28:05.386206 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 11:28:06.652330 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:06.657308 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:28:06.702915 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:28:06.729005 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:28:06.780740 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:28:06.826627 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:28:06.852764 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:28:07.404074 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 11:28:07.409252 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:28:07.420059 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 11:28:07.462510 tst handover.py: using LAC 33646 11:28:07.583399 tst handover.py: using RAC 241 11:28:07.704273 tst handover.py: using CellId 33646 11:28:07.822552 tst handover.py: using BVCI 33647 11:28:07.932233 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 11:28:07.970763 tst handover.py: using LAC 33647 11:28:08.089851 tst handover.py: using RAC 242 11:28:08.210502 tst handover.py: using CellId 33647 11:28:08.329691 tst handover.py: using BVCI 33648 11:28:08.439900 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:28:08.450811 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:28:08.461546 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:28:08.472315 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:28:08.483008 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:28:08.493673 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 11:28:08.614636 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 11:28:08.730633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:09.176487 run create_hlr_db(pid=14208): Launched 11:28:09.301499 bus /sierra_2: Setting Powered False 11:28:10.363073 run create_hlr_db(pid=14208): Terminated: ok {rc=0} 11:28:10.779200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14210): Launched 11:28:11.104682 run osmo-hlr_10.42.42.2(pid=14211): Launched 11:28:11.231019 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:11.766874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14213): Launched 11:28:12.095310 run osmo-stp_10.42.42.5(pid=14214): Launched 11:28:12.219698 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:12.782339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14216): Launched 11:28:13.109433 run osmo-msc_10.42.42.6(pid=14217): Launched 11:28:13.292303 run osmo-stp_10.42.42.5(pid=14214): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14214)] 11:28:13.431183 run osmo-stp_10.42.42.5(pid=14214): stdout: | (launched: 2022-12-13_11:28:12.035811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:13.569768 run osmo-stp_10.42.42.5(pid=14214): stderr: | 20221213112812230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112812230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112812230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112812231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112812231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112812231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112812231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:13.707532 run osmo-stp_10.42.42.5(pid=14214): stdout: | (launched: 2022-12-13_11:28:12.035811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:13.837398 run osmo-stp_10.42.42.5(pid=14214): stderr: | 20221213112812230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112812230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112812230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112812231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112812231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112812231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112812231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:13.992585 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14214): Process ended prematurely: osmo-stp_10.42.42.5(pid=14214) [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14214)] [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 11:28:14.001894 tst handover.py:18: Test FAILED (6.6 sec) 11:28:14.029449 run osmo-hlr_10.42.42.2(pid=14211): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14211)] 11:28:14.080540 run osmo-hlr_10.42.42.2(pid=14211): stdout: | (launched: 2022-12-13_11:28:11.045669) 11:28:14.132865 run osmo-hlr_10.42.42.2(pid=14211): stderr: | 20221213112811244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112811244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112811244 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112811244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112811245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112811245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112811261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112811271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112811271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112811271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:14.206005 run osmo-msc_10.42.42.6(pid=14217): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14217)] 11:28:14.256222 run osmo-msc_10.42.42.6(pid=14217): stdout: | (launched: 2022-12-13_11:28:13.049894) 11:28:14.308314 run osmo-msc_10.42.42.6(pid=14217): stderr: | 20221213112813371 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112813371 DLGLOBAL DEBUG validating counter group 0x7fa4f5a37c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112813371 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112813371 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112813371 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112813371 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112813373 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112813374 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112813374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112813374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:14.361269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14210): Terminating (SIGTERM) 11:28:14.403471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14213): Terminating (SIGTERM) 11:28:14.445450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14216): Terminating (SIGTERM) 11:28:14.487626 --- ParallelTerminationStrategy: PID 14210 died... 11:28:14.508151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14210): Terminated: ok {rc=0} 11:28:14.554689 --- ParallelTerminationStrategy: PID 14213 died... 11:28:14.574810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14213): Terminated: ok {rc=0} 11:28:14.621257 --- ParallelTerminationStrategy: PID 14216 died... 11:28:14.641214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14216): Terminated: ok {rc=0} 11:28:14.729373 bus /sierra_3: Setting Powered False 11:28:15.828838 bus /sierra_3: Setting Powered False 11:28:16.967979 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 11:28:18.238904 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:18.244152 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:28:18.301837 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:28:18.328070 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:28:18.380097 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:28:18.439089 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:28:18.465182 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:28:19.014993 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 11:28:19.020052 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:28:19.030984 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:28:19.073804 tst handover.py: using LAC 33648 11:28:19.195873 tst handover.py: using RAC 243 11:28:19.324552 tst handover.py: using CellId 33648 11:28:19.444466 tst handover.py: using BVCI 33649 11:28:19.554414 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:28:19.600821 tst handover.py: using LAC 33649 11:28:19.718151 tst handover.py: using RAC 244 11:28:19.838189 tst handover.py: using CellId 33649 11:28:19.958113 tst handover.py: using BVCI 33650 11:28:20.067656 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:28:20.078646 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:28:20.089469 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:28:20.100220 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:28:20.111009 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:28:20.121726 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:28:20.242149 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:28:20.359414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:20.806398 run create_hlr_db(pid=14222): Launched 11:28:20.931803 bus /sierra_2: Setting Powered False 11:28:21.993320 run create_hlr_db(pid=14222): Terminated: ok {rc=0} 11:28:22.411349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14224): Launched 11:28:22.738360 run osmo-hlr_10.42.42.2(pid=14225): Launched 11:28:22.862852 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:23.398312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14227): Launched 11:28:23.725712 run osmo-stp_10.42.42.5(pid=14228): Launched 11:28:23.851987 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:24.413772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14230): Launched 11:28:24.740904 run osmo-msc_10.42.42.6(pid=14231): Launched 11:28:24.925338 run osmo-stp_10.42.42.5(pid=14228): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14228)] 11:28:25.063708 run osmo-stp_10.42.42.5(pid=14228): stdout: | (launched: 2022-12-13_11:28:23.665880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:25.202816 run osmo-stp_10.42.42.5(pid=14228): stderr: | 20221213112823863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112823863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112823863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112823864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112823864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112823864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112823864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:25.340924 run osmo-stp_10.42.42.5(pid=14228): stdout: | (launched: 2022-12-13_11:28:23.665880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:25.471486 run osmo-stp_10.42.42.5(pid=14228): stderr: | 20221213112823863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112823863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112823863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112823864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112823864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112823864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112823864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:25.627455 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14228): Process ended prematurely: osmo-stp_10.42.42.5(pid=14228) [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14228)] [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 11:28:25.636228 tst handover.py:18: Test FAILED (6.6 sec) 11:28:25.663704 run osmo-hlr_10.42.42.2(pid=14225): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14225)] 11:28:25.714317 run osmo-hlr_10.42.42.2(pid=14225): stdout: | (launched: 2022-12-13_11:28:22.678657) 11:28:25.766778 run osmo-hlr_10.42.42.2(pid=14225): stderr: | 20221213112822878 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112822878 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112822878 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112822879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112822879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112822879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112822891 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112822899 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112822900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112822900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:25.839717 run osmo-msc_10.42.42.6(pid=14231): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14231)] 11:28:25.889603 run osmo-msc_10.42.42.6(pid=14231): stdout: | (launched: 2022-12-13_11:28:24.681728) 11:28:25.941457 run osmo-msc_10.42.42.6(pid=14231): stderr: | 20221213112825009 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112825009 DLGLOBAL DEBUG validating counter group 0x7fc12c56cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112825010 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112825010 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112825010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112825010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112825012 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112825012 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112825013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112825013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:25.993620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14224): Terminating (SIGTERM) 11:28:26.035953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14227): Terminating (SIGTERM) 11:28:26.077785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14230): Terminating (SIGTERM) 11:28:26.120083 --- ParallelTerminationStrategy: PID 14224 died... 11:28:26.140569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14224): Terminated: ok {rc=0} 11:28:26.187061 --- ParallelTerminationStrategy: PID 14227 died... 11:28:26.206731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14227): Terminated: ok {rc=0} 11:28:26.253170 --- ParallelTerminationStrategy: PID 14230 died... 11:28:26.273144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14230): Terminated: ok {rc=0} 11:28:26.361854 bus /sierra_3: Setting Powered False 11:28:27.460892 bus /sierra_3: Setting Powered False 11:28:28.576696 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 11:28:29.846004 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:29.850971 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:28:29.907735 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:28:29.933822 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:28:29.984865 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:28:30.042955 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:28:30.069242 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:28:30.620632 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 11:28:30.626072 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:28:30.637166 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:28:30.680456 tst handover.py: using LAC 33650 11:28:30.800548 tst handover.py: using RAC 245 11:28:30.943923 tst handover.py: using CellId 33650 11:28:31.096875 tst handover.py: using BVCI 33651 11:28:31.220076 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:28:31.269907 tst handover.py: using LAC 33651 11:28:31.401634 tst handover.py: using RAC 246 11:28:31.573134 tst handover.py: using CellId 33651 11:28:31.730439 tst handover.py: using BVCI 33652 11:28:31.872538 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:28:31.884577 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:28:31.895814 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:28:31.907146 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:28:31.918393 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:28:31.929846 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:28:32.049455 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:28:32.170560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:32.633329 run create_hlr_db(pid=14236): Launched 11:28:32.760218 bus /sierra_2: Setting Powered False 11:28:33.822978 run create_hlr_db(pid=14236): Terminated: ok {rc=0} 11:28:34.221555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14238): Launched 11:28:34.525366 run osmo-hlr_10.42.42.2(pid=14239): Launched 11:28:34.641158 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:35.137546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14241): Launched 11:28:35.441305 run osmo-stp_10.42.42.5(pid=14242): Launched 11:28:35.560103 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:36.083392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14244): Launched 11:28:36.387827 run osmo-msc_10.42.42.6(pid=14245): Launched 11:28:36.559101 run osmo-stp_10.42.42.5(pid=14242): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14242)] 11:28:36.687334 run osmo-stp_10.42.42.5(pid=14242): stdout: | (launched: 2022-12-13_11:28:35.385534) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:36.815050 run osmo-stp_10.42.42.5(pid=14242): stderr: | 20221213112835556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112835557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112835557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112835558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112835558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112835558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112835558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:36.940737 run osmo-stp_10.42.42.5(pid=14242): stdout: | (launched: 2022-12-13_11:28:35.385534) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:37.061316 run osmo-stp_10.42.42.5(pid=14242): stderr: | 20221213112835556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112835557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112835557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112835558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112835558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112835558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112835558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:37.205843 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14242): Process ended prematurely: osmo-stp_10.42.42.5(pid=14242) [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14242)] [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 11:28:37.213973 tst handover.py:18: Test FAILED (6.6 sec) 11:28:37.239795 run osmo-hlr_10.42.42.2(pid=14239): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14239)] 11:28:37.287064 run osmo-hlr_10.42.42.2(pid=14239): stdout: | (launched: 2022-12-13_11:28:34.469698) 11:28:37.335862 run osmo-hlr_10.42.42.2(pid=14239): stderr: | 20221213112834650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112834651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112834651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112834651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112834651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112834651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112834665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112834675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112834675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112834675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:37.404333 run osmo-msc_10.42.42.6(pid=14245): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14245)] 11:28:37.451609 run osmo-msc_10.42.42.6(pid=14245): stdout: | (launched: 2022-12-13_11:28:36.331774) 11:28:37.500552 run osmo-msc_10.42.42.6(pid=14245): stderr: | 20221213112836602 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112836603 DLGLOBAL DEBUG validating counter group 0x7f956b6f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112836603 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112836603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112836603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112836603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112836605 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112836605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112836606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112836606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:37.549817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14238): Terminating (SIGTERM) 11:28:37.589028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14241): Terminating (SIGTERM) 11:28:37.628330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14244): Terminating (SIGTERM) 11:28:37.667847 --- ParallelTerminationStrategy: PID 14238 died... 11:28:37.687007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14238): Terminated: ok {rc=0} 11:28:37.730598 --- ParallelTerminationStrategy: PID 14241 died... 11:28:37.749011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14241): Terminated: ok {rc=0} 11:28:37.792521 --- ParallelTerminationStrategy: PID 14244 died... 11:28:37.811186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14244): Terminated: ok {rc=0} 11:28:37.897281 bus /sierra_3: Setting Powered False 11:28:38.996658 bus /sierra_3: Setting Powered False 11:28:40.112758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 11:28:41.380408 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:41.386305 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:28:41.439733 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:28:41.467066 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:28:41.520127 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:28:41.571333 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:28:41.597476 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:28:42.152277 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 11:28:42.158427 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:28:42.169879 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 11:28:42.220769 tst handover.py: using LAC 33652 11:28:42.344120 tst handover.py: using RAC 247 11:28:42.465363 tst handover.py: using CellId 33652 11:28:42.596192 tst handover.py: using BVCI 33653 11:28:42.715746 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 11:28:42.751599 tst handover.py: using LAC 33653 11:28:42.881763 tst handover.py: using RAC 248 11:28:43.011550 tst handover.py: using CellId 33653 11:28:43.140168 tst handover.py: using BVCI 33654 11:28:43.259330 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:28:43.270722 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:28:43.281925 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:28:43.293031 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:28:43.304929 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:28:43.316914 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 11:28:43.435187 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 11:28:43.550236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:43.999542 run create_hlr_db(pid=14250): Launched 11:28:44.124436 bus /sierra_2: Setting Powered False 11:28:45.186027 run create_hlr_db(pid=14250): Terminated: ok {rc=0} 11:28:45.606680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14252): Launched 11:28:45.940517 run osmo-hlr_10.42.42.2(pid=14253): Launched 11:28:46.199905 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:46.866303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14255): Launched 11:28:47.244120 run osmo-stp_10.42.42.5(pid=14256): Launched 11:28:47.504520 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:48.070791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14258): Launched 11:28:48.401644 run osmo-msc_10.42.42.6(pid=14259): Launched 11:28:48.587219 run osmo-stp_10.42.42.5(pid=14256): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14256)] 11:28:48.726125 run osmo-stp_10.42.42.5(pid=14256): stdout: | (launched: 2022-12-13_11:28:47.185978) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:48.865344 run osmo-stp_10.42.42.5(pid=14256): stderr: | 20221213112847461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112847461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112847462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112847462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112847462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112847462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112847463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:49.002816 run osmo-stp_10.42.42.5(pid=14256): stdout: | (launched: 2022-12-13_11:28:47.185978) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:49.133610 run osmo-stp_10.42.42.5(pid=14256): stderr: | 20221213112847461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112847461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112847462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112847462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112847462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112847462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112847463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:49.289638 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14256): Process ended prematurely: osmo-stp_10.42.42.5(pid=14256) [trial-2388↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14256)] [trial-2388↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 11:28:49.298684 tst handover.py:18: Test FAILED (7.1 sec) 11:28:49.326209 run osmo-hlr_10.42.42.2(pid=14253): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14253)] 11:28:49.377310 run osmo-hlr_10.42.42.2(pid=14253): stdout: | (launched: 2022-12-13_11:28:45.881421) 11:28:49.429575 run osmo-hlr_10.42.42.2(pid=14253): stderr: | 20221213112846122 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112846122 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112846122 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112846122 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112846122 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112846122 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112846139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112846151 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112846152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112846152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:49.502077 run osmo-msc_10.42.42.6(pid=14259): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14259)] 11:28:49.551998 run osmo-msc_10.42.42.6(pid=14259): stdout: | (launched: 2022-12-13_11:28:48.341439) 11:28:49.604053 run osmo-msc_10.42.42.6(pid=14259): stderr: | 20221213112848666 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112848666 DLGLOBAL DEBUG validating counter group 0x7ff7e0a8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112848666 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112848666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112848666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112848666 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112848668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112848668 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112848669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112848669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:49.656621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14252): Terminating (SIGTERM) 11:28:49.699023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14255): Terminating (SIGTERM) 11:28:49.741609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14258): Terminating (SIGTERM) 11:28:49.784276 --- ParallelTerminationStrategy: PID 14252 died... 11:28:49.805198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14252): Terminated: ok {rc=0} 11:28:49.852282 --- ParallelTerminationStrategy: PID 14255 died... 11:28:49.872554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14255): Terminated: ok {rc=0} 11:28:49.919405 --- ParallelTerminationStrategy: PID 14258 died... 11:28:49.939694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14258): Terminated: ok {rc=0} 11:28:50.029347 bus /sierra_3: Setting Powered False 11:28:51.128001 bus /sierra_3: Setting Powered False 11:28:52.243596 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 11:28:53.498950 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:53.504002 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:28:53.566634 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:28:53.592900 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:28:53.643380 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:28:53.708778 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:28:53.734942 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:28:54.283815 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 11:28:54.289193 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:28:54.300158 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:28:54.348112 tst handover.py: using LAC 33654 11:28:54.467938 tst handover.py: using RAC 249 11:28:54.589080 tst handover.py: using CellId 33654 11:28:54.708439 tst handover.py: using BVCI 33655 11:28:54.819846 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:28:54.867686 tst handover.py: using LAC 33655 11:28:54.989005 tst handover.py: using RAC 250 11:28:55.108565 tst handover.py: using CellId 33655 11:28:55.229620 tst handover.py: using BVCI 33656 11:28:55.339712 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:28:55.350712 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:28:55.361451 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:28:55.372154 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:28:55.382884 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:28:55.393603 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:28:55.509342 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:28:55.629264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:56.109984 run create_hlr_db(pid=14264): Launched 11:28:56.236405 bus /sierra_2: Setting Powered False 11:28:57.301362 run create_hlr_db(pid=14264): Terminated: ok {rc=0} 11:28:57.730162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14266): Launched 11:28:58.059159 run osmo-hlr_10.42.42.2(pid=14267): Launched 11:28:58.184739 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:58.685933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14269): Launched 11:28:58.990433 run osmo-stp_10.42.42.5(pid=14270): Launched 11:28:59.106588 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:59.633994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14272): Launched 11:28:59.939208 run osmo-msc_10.42.42.6(pid=14273): Launched 11:29:00.110253 run osmo-stp_10.42.42.5(pid=14270): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14270)] 11:29:00.238829 run osmo-stp_10.42.42.5(pid=14270): stdout: | (launched: 2022-12-13_11:28:58.934676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:00.367526 run osmo-stp_10.42.42.5(pid=14270): stderr: | 20221213112859106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112859106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112859106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112859107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112859107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112859107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112859107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:00.494259 run osmo-stp_10.42.42.5(pid=14270): stdout: | (launched: 2022-12-13_11:28:58.934676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:00.616168 run osmo-stp_10.42.42.5(pid=14270): stderr: | 20221213112859106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112859106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112859106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112859107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112859107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112859107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112859107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:00.762306 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14270): Process ended prematurely: osmo-stp_10.42.42.5(pid=14270) [trial-2388↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14270)] [trial-2388↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 11:29:00.770583 tst handover.py:18: Test FAILED (6.5 sec) 11:29:00.796384 run osmo-hlr_10.42.42.2(pid=14267): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14267)] 11:29:00.843701 run osmo-hlr_10.42.42.2(pid=14267): stdout: | (launched: 2022-12-13_11:28:57.999240) 11:29:00.922414 run osmo-hlr_10.42.42.2(pid=14267): stderr: | 20221213112858197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112858197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112858198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112858198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112858198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112858198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112858210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112858219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112858219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112858219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:01.020793 run osmo-msc_10.42.42.6(pid=14273): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14273)] 11:29:01.074368 run osmo-msc_10.42.42.6(pid=14273): stdout: | (launched: 2022-12-13_11:28:59.883457) 11:29:01.129467 run osmo-msc_10.42.42.6(pid=14273): stderr: | 20221213112900160 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112900160 DLGLOBAL DEBUG validating counter group 0x7fa0fd099c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112900160 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112900160 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112900160 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112900160 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112900162 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112900162 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112900163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112900163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:01.184203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14266): Terminating (SIGTERM) 11:29:01.228394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14269): Terminating (SIGTERM) 11:29:01.273145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14272): Terminating (SIGTERM) 11:29:01.319894 --- ParallelTerminationStrategy: PID 14266 died... 11:29:01.342114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14266): Terminated: ok {rc=0} 11:29:01.393529 --- ParallelTerminationStrategy: PID 14269 died... 11:29:01.415005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14269): Terminated: ok {rc=0} 11:29:01.463677 --- ParallelTerminationStrategy: PID 14272 died... 11:29:01.485487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14272): Terminated: ok {rc=0} 11:29:01.579033 bus /sierra_3: Setting Powered False 11:29:02.679249 bus /sierra_3: Setting Powered False 11:29:03.794834 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 11:29:05.069922 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:29:05.075876 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:29:05.139996 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:29:05.166971 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:29:05.220737 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:29:05.285646 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:29:05.312874 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:29:05.863560 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 11:29:05.869342 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:05.880777 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:29:05.930384 tst handover.py: using LAC 33656 11:29:06.060016 tst handover.py: using RAC 251 11:29:06.188218 tst handover.py: using CellId 33656 11:29:06.319317 tst handover.py: using BVCI 33657 11:29:06.439290 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:29:06.490112 tst handover.py: using LAC 33657 11:29:06.618041 tst handover.py: using RAC 252 11:29:06.745418 tst handover.py: using CellId 33657 11:29:06.865127 tst handover.py: using BVCI 33658 11:29:06.975140 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:06.986207 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:06.997033 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:07.007751 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:07.018612 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:07.029358 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:29:07.144375 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:29:07.265951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:07.746347 run create_hlr_db(pid=14278): Launched 11:29:07.873182 bus /sierra_2: Setting Powered False 11:29:08.938432 run create_hlr_db(pid=14278): Terminated: ok {rc=0} 11:29:09.348850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14280): Launched 11:29:09.654572 run osmo-hlr_10.42.42.2(pid=14281): Launched 11:29:09.773123 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:10.272714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Launched 11:29:10.578275 run osmo-stp_10.42.42.5(pid=14284): Launched 11:29:10.696797 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:11.220093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14286): Launched 11:29:11.524399 run osmo-msc_10.42.42.6(pid=14287): Launched 11:29:11.695626 run osmo-stp_10.42.42.5(pid=14284): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] 11:29:11.823851 run osmo-stp_10.42.42.5(pid=14284): stdout: | (launched: 2022-12-13_11:29:10.522357) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:11.953924 run osmo-stp_10.42.42.5(pid=14284): stderr: | 20221213112910693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112910693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112910694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112910694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112910695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112910695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112910695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:12.081185 run osmo-stp_10.42.42.5(pid=14284): stdout: | (launched: 2022-12-13_11:29:10.522357) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:12.203013 run osmo-stp_10.42.42.5(pid=14284): stderr: | 20221213112910693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112910693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112910694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112910694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112910695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112910695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112910695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:12.347820 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14284): Process ended prematurely: osmo-stp_10.42.42.5(pid=14284) [trial-2388↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] [trial-2388↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 11:29:12.356230 tst handover.py:18: Test FAILED (6.5 sec) 11:29:12.382412 run osmo-hlr_10.42.42.2(pid=14281): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14281)] 11:29:12.430833 run osmo-hlr_10.42.42.2(pid=14281): stdout: | (launched: 2022-12-13_11:29:09.598318) 11:29:12.480434 run osmo-hlr_10.42.42.2(pid=14281): stderr: | 20221213112909776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112909776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112909776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112909776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112909776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112909776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112909790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112909800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112909801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112909801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:12.549503 run osmo-msc_10.42.42.6(pid=14287): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14287)] 11:29:12.597295 run osmo-msc_10.42.42.6(pid=14287): stdout: | (launched: 2022-12-13_11:29:11.468370) 11:29:12.646502 run osmo-msc_10.42.42.6(pid=14287): stderr: | 20221213112911742 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112911742 DLGLOBAL DEBUG validating counter group 0x7f7e13221c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112911742 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112911742 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112911742 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112911742 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112911744 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112911744 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112911745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112911745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:12.696159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14280): Terminating (SIGTERM) 11:29:12.735572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Terminating (SIGTERM) 11:29:12.775362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14286): Terminating (SIGTERM) 11:29:12.815454 --- ParallelTerminationStrategy: PID 14280 died... 11:29:12.834695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14280): Terminated: ok {rc=0} 11:29:12.878739 --- ParallelTerminationStrategy: PID 14283 died... 11:29:12.897643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Terminated: ok {rc=0} 11:29:12.941402 --- ParallelTerminationStrategy: PID 14286 died... 11:29:12.960371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14286): Terminated: ok {rc=0} 11:29:13.044185 bus /sierra_3: Setting Powered False 11:29:14.139409 bus /sierra_3: Setting Powered False 11:29:15.255009 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 11:29:16.528005 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:29:16.534011 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:29:16.585226 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:29:16.620443 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:29:16.688301 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:29:16.742291 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:29:16.769553 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:29:17.317439 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 11:29:17.323413 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:29:17.334814 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:29:17.368098 tst handover.py: using LAC 33658 11:29:17.498218 tst handover.py: using RAC 253 11:29:17.626474 tst handover.py: using CellId 33658 11:29:17.754615 tst handover.py: using BVCI 33659 11:29:17.876056 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:29:17.924237 tst handover.py: using LAC 33659 11:29:18.052116 tst handover.py: using RAC 254 11:29:18.179265 tst handover.py: using CellId 33659 11:29:18.306899 tst handover.py: using BVCI 33660 11:29:18.426314 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:29:18.437472 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:29:18.448433 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:29:18.459402 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:29:18.471339 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:29:18.483169 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:29:18.603913 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:29:18.721278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:19.167934 run create_hlr_db(pid=14293): Launched 11:29:19.293435 bus /sierra_2: Setting Powered False 11:29:20.354357 run create_hlr_db(pid=14293): Terminated: ok {rc=0} 11:29:20.773111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14295): Launched 11:29:21.099489 run osmo-hlr_10.42.42.2(pid=14296): Launched 11:29:21.228259 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:21.764761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14298): Launched 11:29:22.093608 run osmo-stp_10.42.42.5(pid=14299): Launched 11:29:22.219930 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:22.781486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14301): Launched 11:29:23.109160 run osmo-msc_10.42.42.6(pid=14302): Launched 11:29:23.292412 run osmo-stp_10.42.42.5(pid=14299): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14299)] 11:29:23.430636 run osmo-stp_10.42.42.5(pid=14299): stdout: | (launched: 2022-12-13_11:29:22.033955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:23.568159 run osmo-stp_10.42.42.5(pid=14299): stderr: | 20221213112922227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112922227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112922227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112922228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112922228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112922228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112922228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:23.705441 run osmo-stp_10.42.42.5(pid=14299): stdout: | (launched: 2022-12-13_11:29:22.033955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:23.835760 run osmo-stp_10.42.42.5(pid=14299): stderr: | 20221213112922227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112922227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112922227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112922228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112922228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112922228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112922228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:23.991404 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14299): Process ended prematurely: osmo-stp_10.42.42.5(pid=14299) [trial-2388↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14299)] [trial-2388↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 11:29:24.000249 tst handover.py:18: Test FAILED (6.7 sec) 11:29:24.027723 run osmo-hlr_10.42.42.2(pid=14296): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14296)] 11:29:24.078480 run osmo-hlr_10.42.42.2(pid=14296): stdout: | (launched: 2022-12-13_11:29:21.040033) 11:29:24.130700 run osmo-hlr_10.42.42.2(pid=14296): stderr: | 20221213112921240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112921240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112921240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112921240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112921241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112921241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112921251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112921260 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112921260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112921260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:24.202996 run osmo-msc_10.42.42.6(pid=14302): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14302)] 11:29:24.252914 run osmo-msc_10.42.42.6(pid=14302): stdout: | (launched: 2022-12-13_11:29:23.049639) 11:29:24.304618 run osmo-msc_10.42.42.6(pid=14302): stderr: | 20221213112923373 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112923373 DLGLOBAL DEBUG validating counter group 0x7f4bdbf64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112923373 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112923373 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112923374 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112923374 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112923376 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112923376 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112923376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112923376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:24.357048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14295): Terminating (SIGTERM) 11:29:24.399425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14298): Terminating (SIGTERM) 11:29:24.441685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14301): Terminating (SIGTERM) 11:29:24.484530 --- ParallelTerminationStrategy: PID 14295 died... 11:29:24.505093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14295): Terminated: ok {rc=0} 11:29:24.551793 --- ParallelTerminationStrategy: PID 14298 died... 11:29:24.571774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14298): Terminated: ok {rc=0} 11:29:24.618386 --- ParallelTerminationStrategy: PID 14301 died... 11:29:24.638355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14301): Terminated: ok {rc=0} 11:29:24.726111 bus /sierra_3: Setting Powered False 11:29:25.826662 bus /sierra_3: Setting Powered False 11:29:26.941793 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 11:29:28.196267 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:29:28.202007 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:29:28.253486 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:29:28.280544 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:29:28.333708 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:29:28.383903 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:29:28.410203 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:29:28.961997 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 11:29:28.968362 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:28.979926 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:29:29.018638 tst handover.py: using LAC 33660 11:29:29.139319 tst handover.py: using RAC 255 11:29:29.257534 tst handover.py: using CellId 33660 11:29:29.375698 tst handover.py: using BVCI 33661 11:29:29.486131 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:29:29.531799 tst handover.py: using LAC 33661 11:29:29.663314 tst handover.py: using RAC 1 11:29:29.789373 tst handover.py: using CellId 33661 11:29:29.920505 tst handover.py: using BVCI 33662 11:29:30.040157 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:30.051556 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:30.062724 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:30.073957 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:30.085488 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:30.097075 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:29:30.213853 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:29:30.334520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:30.815424 run create_hlr_db(pid=14307): Launched 11:29:30.972389 bus /sierra_2: Setting Powered False 11:29:32.053759 run create_hlr_db(pid=14307): Terminated: ok {rc=0} 11:29:32.462712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14309): Launched 11:29:32.767658 run osmo-hlr_10.42.42.2(pid=14310): Launched 11:29:32.884447 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:33.383627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14312): Launched 11:29:33.687782 run osmo-stp_10.42.42.5(pid=14313): Launched 11:29:33.803714 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:34.329131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14315): Launched 11:29:34.633221 run osmo-msc_10.42.42.6(pid=14316): Launched 11:29:34.803359 run osmo-stp_10.42.42.5(pid=14313): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14313)] 11:29:34.932477 run osmo-stp_10.42.42.5(pid=14313): stdout: | (launched: 2022-12-13_11:29:33.631953) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:35.061120 run osmo-stp_10.42.42.5(pid=14313): stderr: | 20221213112933805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112933805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112933806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112933806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112933807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112933807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112933807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:35.187689 run osmo-stp_10.42.42.5(pid=14313): stdout: | (launched: 2022-12-13_11:29:33.631953) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:35.308926 run osmo-stp_10.42.42.5(pid=14313): stderr: | 20221213112933805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112933805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112933806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112933806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112933807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112933807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112933807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:35.453942 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14313): Process ended prematurely: osmo-stp_10.42.42.5(pid=14313) [trial-2388↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14313)] [trial-2388↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 11:29:35.462311 tst handover.py:18: Test FAILED (6.5 sec) 11:29:35.488328 run osmo-hlr_10.42.42.2(pid=14310): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14310)] 11:29:35.536587 run osmo-hlr_10.42.42.2(pid=14310): stdout: | (launched: 2022-12-13_11:29:32.711399) 11:29:35.586150 run osmo-hlr_10.42.42.2(pid=14310): stderr: | 20221213112932889 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112932889 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112932889 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112932889 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112932889 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112932889 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112932947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112932958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112932958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112932958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:35.655414 run osmo-msc_10.42.42.6(pid=14316): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14316)] 11:29:35.703144 run osmo-msc_10.42.42.6(pid=14316): stdout: | (launched: 2022-12-13_11:29:34.577378) 11:29:35.753107 run osmo-msc_10.42.42.6(pid=14316): stderr: | 20221213112934848 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112934848 DLGLOBAL DEBUG validating counter group 0x7f8fc714fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112934848 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112934848 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112934849 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112934849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112934850 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112934851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112934851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112934851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:35.802881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14309): Terminating (SIGTERM) 11:29:35.842427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14312): Terminating (SIGTERM) 11:29:35.881952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14315): Terminating (SIGTERM) 11:29:35.921825 --- ParallelTerminationStrategy: PID 14309 died... 11:29:35.941181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14309): Terminated: ok {rc=0} 11:29:35.985571 --- ParallelTerminationStrategy: PID 14312 died... 11:29:36.004376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14312): Terminated: ok {rc=0} 11:29:36.048200 --- ParallelTerminationStrategy: PID 14315 died... 11:29:36.066969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14315): Terminated: ok {rc=0} 11:29:36.149988 bus /sierra_3: Setting Powered False 11:29:37.247550 bus /sierra_3: Setting Powered False 11:29:38.364170 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2388 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 11:29:39.632424 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:29:39.637798 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:29:39.698935 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:29:39.725323 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:29:39.775314 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:29:39.836852 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:29:39.863039 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:29:40.414608 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2388 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 11:29:40.420097 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:40.431097 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:29:40.478880 tst handover.py: using LAC 33662 11:29:40.606287 tst handover.py: using RAC 2 11:29:40.735476 tst handover.py: using CellId 33662 11:29:40.867407 tst handover.py: using BVCI 33663 11:29:40.987476 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:29:41.034601 tst handover.py: using LAC 33663 11:29:41.162660 tst handover.py: using RAC 3 11:29:41.287993 tst handover.py: using CellId 33663 11:29:41.414667 tst handover.py: using BVCI 33664 11:29:41.533315 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:41.544666 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:41.555907 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:41.567255 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:41.578857 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:29:41.590399 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:29:41.708443 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:29:41.830921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:42.311164 run create_hlr_db(pid=14321): Launched 11:29:42.436714 bus /sierra_2: Setting Powered False 11:29:43.501253 run create_hlr_db(pid=14321): Terminated: ok {rc=0} 11:29:43.928651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14323): Launched 11:29:44.256587 run osmo-hlr_10.42.42.2(pid=14324): Launched 11:29:44.383405 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:44.919666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14326): Launched 11:29:45.247627 run osmo-stp_10.42.42.5(pid=14327): Launched 11:29:45.373913 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:45.961743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14329): Launched 11:29:46.290040 run osmo-msc_10.42.42.6(pid=14330): Launched 11:29:46.687747 run osmo-stp_10.42.42.5(pid=14327): ERR: Terminated: ERROR {rc=1} [trial-2388↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14327)] 11:29:47.114287 run osmo-stp_10.42.42.5(pid=14327): stdout: | (launched: 2022-12-13_11:29:45.187602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:47.245675 run osmo-stp_10.42.42.5(pid=14327): stderr: | 20221213112945382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112945382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112945382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112945383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112945383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112945383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112945383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:47.375988 run osmo-stp_10.42.42.5(pid=14327): stdout: | (launched: 2022-12-13_11:29:45.187602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:47.500089 run osmo-stp_10.42.42.5(pid=14327): stderr: | 20221213112945382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213112945382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213112945382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213112945383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213112945383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213112945383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213112945383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:47.645974 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14327): Process ended prematurely: osmo-stp_10.42.42.5(pid=14327) [trial-2388↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14327)] [trial-2388↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 11:29:47.654272 tst handover.py:18: Test FAILED (7.2 sec) 11:29:47.680708 run osmo-hlr_10.42.42.2(pid=14324): ERR: Terminated: ERROR {rc=237} [trial-2388↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14324)] 11:29:47.730106 run osmo-hlr_10.42.42.2(pid=14324): stdout: | (launched: 2022-12-13_11:29:44.196885) 11:29:47.780316 run osmo-hlr_10.42.42.2(pid=14324): stderr: | 20221213112944400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213112944400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213112944400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213112944400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213112944400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213112944400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213112944413 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213112944421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213112944422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213112944422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:47.850393 run osmo-msc_10.42.42.6(pid=14330): ERR: Terminated: ERROR {rc=2} [trial-2388↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14330)] 11:29:47.898375 run osmo-msc_10.42.42.6(pid=14330): stdout: | (launched: 2022-12-13_11:29:46.232647) 11:29:47.948545 run osmo-msc_10.42.42.6(pid=14330): stderr: | 20221213112946711 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213112946711 DLGLOBAL DEBUG validating counter group 0x7f62ad1d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213112946711 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213112946711 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213112946711 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213112946712 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213112946713 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213112946714 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213112946714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213112946714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:47.999070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14323): Terminating (SIGTERM) 11:29:48.039423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14326): Terminating (SIGTERM) 11:29:48.079905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14329): Terminating (SIGTERM) 11:29:48.120600 --- ParallelTerminationStrategy: PID 14323 died... 11:29:48.140259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14323): Terminated: ok {rc=0} 11:29:48.185302 --- ParallelTerminationStrategy: PID 14326 died... 11:29:48.204122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14326): Terminated: ok {rc=0} 11:29:48.248560 --- ParallelTerminationStrategy: PID 14329 died... 11:29:48.267482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14329): Terminated: ok {rc=0} 11:29:48.353053 bus /sierra_3: Setting Powered False 11:29:49.453684 bus /sierra_3: Setting Powered False 11:29:50.572053 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2388 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 11:29:51.848021 tst trial-2388: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388/run.2022-12-13_10-04-59/trial-2388.xml -------------------------------------------------------------------------------------------- trial-2388 FAIL -------------------------------------------------------------------------------------------- 11:29:53.780604 tst trial-2388: trial-2388: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.9 sec) Error: osmo-nitb_10.42.42.2(pid=6942): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6942) [trial-2388↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6942)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.6 sec) Error: osmo-stp_10.42.42.5(pid=6952): Process ended prematurely: osmo-stp_10.42.42.5(pid=6952) [trial-2388↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6952)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=6962): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6962) [trial-2388↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6962)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6973): Process ended prematurely: osmo-stp_10.42.42.5(pid=6973) [trial-2388↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6973)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6987): Process ended prematurely: osmo-stp_10.42.42.5(pid=6987) [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6987)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6998): Process ended prematurely: osmo-stp_10.42.42.5(pid=6998) [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6998)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7012): Process ended prematurely: osmo-stp_10.42.42.5(pid=7012) [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7012)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7023): Process ended prematurely: osmo-stp_10.42.42.5(pid=7023) [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7023)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7037): Process ended prematurely: osmo-stp_10.42.42.5(pid=7037) [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7037)] FAIL: mo_mt_call_osmux.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=7252): Process ended prematurely: osmo-stp_10.42.42.5(pid=7252) [trial-2388↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7252)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7334): Process ended prematurely: osmo-stp_10.42.42.5(pid=7334) [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7334)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7345): Process ended prematurely: osmo-stp_10.42.42.5(pid=7345) [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7345)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7359): Process ended prematurely: osmo-stp_10.42.42.5(pid=7359) [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7359)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7370): Process ended prematurely: osmo-stp_10.42.42.5(pid=7370) [trial-2388↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7370)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7384): Process ended prematurely: osmo-stp_10.42.42.5(pid=7384) [trial-2388↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7384)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7395): Process ended prematurely: osmo-stp_10.42.42.5(pid=7395) [trial-2388↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7395)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7412): Process ended prematurely: osmo-stp_10.42.42.5(pid=7412) [trial-2388↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7412)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7423): Process ended prematurely: osmo-stp_10.42.42.5(pid=7423) [trial-2388↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7423)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7437): Process ended prematurely: osmo-stp_10.42.42.5(pid=7437) [trial-2388↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7437)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7448): Process ended prematurely: osmo-stp_10.42.42.5(pid=7448) [trial-2388↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7448)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=7470): Process ended prematurely: osmo-stp_10.42.42.5(pid=7470) [trial-2388↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7470)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7482): Process ended prematurely: osmo-stp_10.42.42.5(pid=7482) [trial-2388↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7482)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=7500): Process ended prematurely: osmo-stp_10.42.42.5(pid=7500) [trial-2388↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7500)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7510): Process ended prematurely: osmo-stp_10.42.42.5(pid=7510) [trial-2388↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7510)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7520): Process ended prematurely: osmo-stp_10.42.42.5(pid=7520) [trial-2388↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7520)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=7537): Process ended prematurely: osmo-stp_10.42.42.5(pid=7537) [trial-2388↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7537)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7549): Process ended prematurely: osmo-stp_10.42.42.5(pid=7549) [trial-2388↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7549)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7567): Process ended prematurely: osmo-stp_10.42.42.5(pid=7567) [trial-2388↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7567)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7577): Process ended prematurely: osmo-stp_10.42.42.5(pid=7577) [trial-2388↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7577)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7587): Process ended prematurely: osmo-stp_10.42.42.5(pid=7587) [trial-2388↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7587)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=7605): Process ended prematurely: osmo-stp_10.42.42.5(pid=7605) [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7605)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=7617): Process ended prematurely: osmo-stp_10.42.42.5(pid=7617) [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7617)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7645): Process ended prematurely: osmo-stp_10.42.42.5(pid=7645) [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7645)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7655): Process ended prematurely: osmo-stp_10.42.42.5(pid=7655) [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7655)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7665): Process ended prematurely: osmo-stp_10.42.42.5(pid=7665) [trial-2388↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7665)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=7682): Process ended prematurely: osmo-stp_10.42.42.5(pid=7682) [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7682)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=7695): Process ended prematurely: osmo-stp_10.42.42.5(pid=7695) [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7695)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7713): Process ended prematurely: osmo-stp_10.42.42.5(pid=7713) [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7713)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7723): Process ended prematurely: osmo-stp_10.42.42.5(pid=7723) [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7723)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=7733): Process ended prematurely: osmo-stp_10.42.42.5(pid=7733) [trial-2388↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7733)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=7749): Process ended prematurely: osmo-stp_10.42.42.5(pid=7749) [trial-2388↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7749)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=7762): Process ended prematurely: osmo-stp_10.42.42.5(pid=7762) [trial-2388↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7762)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=7770): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7770) [trial-2388↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7770)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7780): Process ended prematurely: osmo-stp_10.42.42.5(pid=7780) [trial-2388↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7780)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=7789): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7789) [trial-2388↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7789)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7799): Process ended prematurely: osmo-stp_10.42.42.5(pid=7799) [trial-2388↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7799)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7816): Process ended prematurely: osmo-stp_10.42.42.5(pid=7816) [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7816)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7827): Process ended prematurely: osmo-stp_10.42.42.5(pid=7827) [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7827)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7842): Process ended prematurely: osmo-stp_10.42.42.5(pid=7842) [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7842)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=7853): Process ended prematurely: osmo-stp_10.42.42.5(pid=7853) [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7853)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7867): Process ended prematurely: osmo-stp_10.42.42.5(pid=7867) [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7867)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7878): Process ended prematurely: osmo-stp_10.42.42.5(pid=7878) [trial-2388↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7878)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7895): Process ended prematurely: osmo-stp_10.42.42.5(pid=7895) [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7895)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7906): Process ended prematurely: osmo-stp_10.42.42.5(pid=7906) [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7906)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7920): Process ended prematurely: osmo-stp_10.42.42.5(pid=7920) [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7920)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7931): Process ended prematurely: osmo-stp_10.42.42.5(pid=7931) [trial-2388↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7931)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7945): Process ended prematurely: osmo-stp_10.42.42.5(pid=7945) [trial-2388↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7945)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7956): Process ended prematurely: osmo-stp_10.42.42.5(pid=7956) [trial-2388↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7956)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7971): Process ended prematurely: osmo-stp_10.42.42.5(pid=7971) [trial-2388↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7971)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7982): Process ended prematurely: osmo-stp_10.42.42.5(pid=7982) [trial-2388↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7982)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7996): Process ended prematurely: osmo-stp_10.42.42.5(pid=7996) [trial-2388↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7996)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8007): Process ended prematurely: osmo-stp_10.42.42.5(pid=8007) [trial-2388↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8007)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=8025): Process ended prematurely: osmo-stp_10.42.42.5(pid=8025) [trial-2388↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8025)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=8037): Process ended prematurely: osmo-stp_10.42.42.5(pid=8037) [trial-2388↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8037)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=8056): Process ended prematurely: osmo-stp_10.42.42.5(pid=8056) [trial-2388↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8056)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8066): Process ended prematurely: osmo-stp_10.42.42.5(pid=8066) [trial-2388↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8066)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8076): Process ended prematurely: osmo-stp_10.42.42.5(pid=8076) [trial-2388↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8076)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=8093): Process ended prematurely: osmo-stp_10.42.42.5(pid=8093) [trial-2388↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8093)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=8108): Process ended prematurely: osmo-stp_10.42.42.5(pid=8108) [trial-2388↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8108)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=8126): Process ended prematurely: osmo-stp_10.42.42.5(pid=8126) [trial-2388↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8126)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8136): Process ended prematurely: osmo-stp_10.42.42.5(pid=8136) [trial-2388↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8136)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8146): Process ended prematurely: osmo-stp_10.42.42.5(pid=8146) [trial-2388↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8146)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=8166): Process ended prematurely: osmo-stp_10.42.42.5(pid=8166) [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8166)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=8178): Process ended prematurely: osmo-stp_10.42.42.5(pid=8178) [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8178)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8196): Process ended prematurely: osmo-stp_10.42.42.5(pid=8196) [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8196)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8206): Process ended prematurely: osmo-stp_10.42.42.5(pid=8206) [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8206)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8216): Process ended prematurely: osmo-stp_10.42.42.5(pid=8216) [trial-2388↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8216)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=8233): Process ended prematurely: osmo-stp_10.42.42.5(pid=8233) [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8233)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8245): Process ended prematurely: osmo-stp_10.42.42.5(pid=8245) [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8245)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8263): Process ended prematurely: osmo-stp_10.42.42.5(pid=8263) [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8263)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8273): Process ended prematurely: osmo-stp_10.42.42.5(pid=8273) [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8273)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8283): Process ended prematurely: osmo-stp_10.42.42.5(pid=8283) [trial-2388↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8283)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=8297): Process ended prematurely: osmo-stp_10.42.42.5(pid=8297) [trial-2388↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8297)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8313): Process ended prematurely: osmo-stp_10.42.42.5(pid=8313) [trial-2388↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8313)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=8321): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8321) [trial-2388↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8321)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8331): Process ended prematurely: osmo-stp_10.42.42.5(pid=8331) [trial-2388↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8331)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=8340): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8340) [trial-2388↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8340)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=8518): Process ended prematurely: osmo-stp_10.42.42.5(pid=8518) [trial-2388↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8518)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=8636): Process ended prematurely: osmo-stp_10.42.42.5(pid=8636) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8636)] FAIL: mo_mt_call_osmux.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=8647): Process ended prematurely: osmo-stp_10.42.42.5(pid=8647) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8647)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8661): Process ended prematurely: osmo-stp_10.42.42.5(pid=8661) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8661)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8672): Process ended prematurely: osmo-stp_10.42.42.5(pid=8672) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8672)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8687): Process ended prematurely: osmo-stp_10.42.42.5(pid=8687) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8687)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8698): Process ended prematurely: osmo-stp_10.42.42.5(pid=8698) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8698)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8715): Process ended prematurely: osmo-stp_10.42.42.5(pid=8715) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8715)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8727): Process ended prematurely: osmo-stp_10.42.42.5(pid=8727) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8727)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8741): Process ended prematurely: osmo-stp_10.42.42.5(pid=8741) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8741)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8752): Process ended prematurely: osmo-stp_10.42.42.5(pid=8752) [trial-2388↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8752)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8766): Process ended prematurely: osmo-stp_10.42.42.5(pid=8766) [trial-2388↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8766)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8781): Process ended prematurely: osmo-stp_10.42.42.5(pid=8781) [trial-2388↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8781)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8795): Process ended prematurely: osmo-stp_10.42.42.5(pid=8795) [trial-2388↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8795)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8806): Process ended prematurely: osmo-stp_10.42.42.5(pid=8806) [trial-2388↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8806)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8820): Process ended prematurely: osmo-stp_10.42.42.5(pid=8820) [trial-2388↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8820)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8831): Process ended prematurely: osmo-stp_10.42.42.5(pid=8831) [trial-2388↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8831)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8847): Process ended prematurely: osmo-stp_10.42.42.5(pid=8847) [trial-2388↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8847)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8859): Process ended prematurely: osmo-stp_10.42.42.5(pid=8859) [trial-2388↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8859)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8873): Process ended prematurely: osmo-stp_10.42.42.5(pid=8873) [trial-2388↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8873)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8884): Process ended prematurely: osmo-stp_10.42.42.5(pid=8884) [trial-2388↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8884)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=8902): Process ended prematurely: osmo-stp_10.42.42.5(pid=8902) [trial-2388↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8902)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=8914): Process ended prematurely: osmo-stp_10.42.42.5(pid=8914) [trial-2388↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8914)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=8932): Process ended prematurely: osmo-stp_10.42.42.5(pid=8932) [trial-2388↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8932)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8942): Process ended prematurely: osmo-stp_10.42.42.5(pid=8942) [trial-2388↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8942)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8952): Process ended prematurely: osmo-stp_10.42.42.5(pid=8952) [trial-2388↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8952)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=8969): Process ended prematurely: osmo-stp_10.42.42.5(pid=8969) [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8969)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=8981): Process ended prematurely: osmo-stp_10.42.42.5(pid=8981) [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8981)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=9000): Process ended prematurely: osmo-stp_10.42.42.5(pid=9000) [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9000)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9010): Process ended prematurely: osmo-stp_10.42.42.5(pid=9010) [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9010)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9020): Process ended prematurely: osmo-stp_10.42.42.5(pid=9020) [trial-2388↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9020)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=9040): Process ended prematurely: osmo-stp_10.42.42.5(pid=9040) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9040)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=9052): Process ended prematurely: osmo-stp_10.42.42.5(pid=9052) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9052)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=9073): Process ended prematurely: osmo-stp_10.42.42.5(pid=9073) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9073)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9083): Process ended prematurely: osmo-stp_10.42.42.5(pid=9083) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9083)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9093): Process ended prematurely: osmo-stp_10.42.42.5(pid=9093) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9093)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=9112): Process ended prematurely: osmo-stp_10.42.42.5(pid=9112) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9112)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=9127): Process ended prematurely: osmo-stp_10.42.42.5(pid=9127) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9127)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=9145): Process ended prematurely: osmo-stp_10.42.42.5(pid=9145) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9145)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=9155): Process ended prematurely: osmo-stp_10.42.42.5(pid=9155) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9155)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9165): Process ended prematurely: osmo-stp_10.42.42.5(pid=9165) [trial-2388↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9165)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=9182): Process ended prematurely: osmo-stp_10.42.42.5(pid=9182) [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9182)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=9194): Process ended prematurely: osmo-stp_10.42.42.5(pid=9194) [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9194)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=9212): Process ended prematurely: osmo-stp_10.42.42.5(pid=9212) [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9212)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=9222): Process ended prematurely: osmo-stp_10.42.42.5(pid=9222) [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9222)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9232): Process ended prematurely: osmo-stp_10.42.42.5(pid=9232) [trial-2388↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9232)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=9246): Process ended prematurely: osmo-stp_10.42.42.5(pid=9246) [trial-2388↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9246)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=9264): Process ended prematurely: osmo-stp_10.42.42.5(pid=9264) [trial-2388↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9264)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9272): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9272) [trial-2388↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9272)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9282): Process ended prematurely: osmo-stp_10.42.42.5(pid=9282) [trial-2388↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9282)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9291): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9291) [trial-2388↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9291)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9301): Process ended prematurely: osmo-stp_10.42.42.5(pid=9301) [trial-2388↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9301)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9315): Process ended prematurely: osmo-stp_10.42.42.5(pid=9315) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9315)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9326): Process ended prematurely: osmo-stp_10.42.42.5(pid=9326) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9326)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9341): Process ended prematurely: osmo-stp_10.42.42.5(pid=9341) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9341)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9352): Process ended prematurely: osmo-stp_10.42.42.5(pid=9352) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9352)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9366): Process ended prematurely: osmo-stp_10.42.42.5(pid=9366) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9366)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9377): Process ended prematurely: osmo-stp_10.42.42.5(pid=9377) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9377)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9391): Process ended prematurely: osmo-stp_10.42.42.5(pid=9391) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9391)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9406): Process ended prematurely: osmo-stp_10.42.42.5(pid=9406) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9406)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9421): Process ended prematurely: osmo-stp_10.42.42.5(pid=9421) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9421)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9432): Process ended prematurely: osmo-stp_10.42.42.5(pid=9432) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9432)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9446): Process ended prematurely: osmo-stp_10.42.42.5(pid=9446) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9446)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9457): Process ended prematurely: osmo-stp_10.42.42.5(pid=9457) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9457)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9473): Process ended prematurely: osmo-stp_10.42.42.5(pid=9473) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9473)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9484): Process ended prematurely: osmo-stp_10.42.42.5(pid=9484) [trial-2388↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9484)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9498): Process ended prematurely: osmo-stp_10.42.42.5(pid=9498) [trial-2388↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9498)] FAIL: emergency_preemptive_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=9509): Process ended prematurely: osmo-stp_10.42.42.5(pid=9509) [trial-2388↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9509)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=9527): Process ended prematurely: osmo-stp_10.42.42.5(pid=9527) [trial-2388↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9527)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=9539): Process ended prematurely: osmo-stp_10.42.42.5(pid=9539) [trial-2388↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9539)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=9557): Process ended prematurely: osmo-stp_10.42.42.5(pid=9557) [trial-2388↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9557)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=9567): Process ended prematurely: osmo-stp_10.42.42.5(pid=9567) [trial-2388↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9567)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9577): Process ended prematurely: osmo-stp_10.42.42.5(pid=9577) [trial-2388↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=9597): Process ended prematurely: osmo-stp_10.42.42.5(pid=9597) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9597)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=9609): Process ended prematurely: osmo-stp_10.42.42.5(pid=9609) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9609)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=9627): Process ended prematurely: osmo-stp_10.42.42.5(pid=9627) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9627)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9637): Process ended prematurely: osmo-stp_10.42.42.5(pid=9637) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9637)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9647): Process ended prematurely: osmo-stp_10.42.42.5(pid=9647) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9647)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=9938): Process ended prematurely: osmo-stp_10.42.42.5(pid=9938) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9938)] FAIL: iperf3.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=9950): Process ended prematurely: osmo-stp_10.42.42.5(pid=9950) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9950)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=9969): Process ended prematurely: osmo-stp_10.42.42.5(pid=9969) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9969)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9979): Process ended prematurely: osmo-stp_10.42.42.5(pid=9979) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9979)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9989): Process ended prematurely: osmo-stp_10.42.42.5(pid=9989) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9989)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=10006): Process ended prematurely: osmo-stp_10.42.42.5(pid=10006) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10006)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10022): Process ended prematurely: osmo-stp_10.42.42.5(pid=10022) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10022)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=10040): Process ended prematurely: osmo-stp_10.42.42.5(pid=10040) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10040)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10050): Process ended prematurely: osmo-stp_10.42.42.5(pid=10050) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10050)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10060): Process ended prematurely: osmo-stp_10.42.42.5(pid=10060) [trial-2388↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10060)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10073): Process ended prematurely: osmo-stp_10.42.42.5(pid=10073) [trial-2388↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10073)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10090): Process ended prematurely: osmo-stp_10.42.42.5(pid=10090) [trial-2388↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10090)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=10098): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10098) [trial-2388↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10098)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=10108): Process ended prematurely: osmo-stp_10.42.42.5(pid=10108) [trial-2388↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10108)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=10117): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10117) [trial-2388↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10117)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10127): Process ended prematurely: osmo-stp_10.42.42.5(pid=10127) [trial-2388↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10127)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10141): Process ended prematurely: osmo-stp_10.42.42.5(pid=10141) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10141)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10152): Process ended prematurely: osmo-stp_10.42.42.5(pid=10152) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10152)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10170): Process ended prematurely: osmo-stp_10.42.42.5(pid=10170) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10170)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10181): Process ended prematurely: osmo-stp_10.42.42.5(pid=10181) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10181)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10197): Process ended prematurely: osmo-stp_10.42.42.5(pid=10197) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10197)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10208): Process ended prematurely: osmo-stp_10.42.42.5(pid=10208) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10208)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10222): Process ended prematurely: osmo-stp_10.42.42.5(pid=10222) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10222)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10233): Process ended prematurely: osmo-stp_10.42.42.5(pid=10233) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10233)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10247): Process ended prematurely: osmo-stp_10.42.42.5(pid=10247) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10247)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10258): Process ended prematurely: osmo-stp_10.42.42.5(pid=10258) [trial-2388↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10258)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10272): Process ended prematurely: osmo-stp_10.42.42.5(pid=10272) [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10272)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10283): Process ended prematurely: osmo-stp_10.42.42.5(pid=10283) [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10283)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10297): Process ended prematurely: osmo-stp_10.42.42.5(pid=10297) [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10297)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10308): Process ended prematurely: osmo-stp_10.42.42.5(pid=10308) [trial-2388↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10308)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10324): Process ended prematurely: osmo-stp_10.42.42.5(pid=10324) [trial-2388↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10324)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10335): Process ended prematurely: osmo-stp_10.42.42.5(pid=10335) [trial-2388↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10335)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10350): Process ended prematurely: osmo-stp_10.42.42.5(pid=10350) [trial-2388↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10350)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10361): Process ended prematurely: osmo-stp_10.42.42.5(pid=10361) [trial-2388↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10361)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10382): Process ended prematurely: osmo-stp_10.42.42.5(pid=10382) [trial-2388↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10382)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10394): Process ended prematurely: osmo-stp_10.42.42.5(pid=10394) [trial-2388↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10394)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10412): Process ended prematurely: osmo-stp_10.42.42.5(pid=10412) [trial-2388↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10412)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10422): Process ended prematurely: osmo-stp_10.42.42.5(pid=10422) [trial-2388↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10422)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10432): Process ended prematurely: osmo-stp_10.42.42.5(pid=10432) [trial-2388↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10432)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=10449): Process ended prematurely: osmo-stp_10.42.42.5(pid=10449) [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10449)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=10461): Process ended prematurely: osmo-stp_10.42.42.5(pid=10461) [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10461)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=10479): Process ended prematurely: osmo-stp_10.42.42.5(pid=10479) [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10479)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10489): Process ended prematurely: osmo-stp_10.42.42.5(pid=10489) [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10489)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10499): Process ended prematurely: osmo-stp_10.42.42.5(pid=10499) [trial-2388↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10499)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10516): Process ended prematurely: osmo-stp_10.42.42.5(pid=10516) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10516)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10528): Process ended prematurely: osmo-stp_10.42.42.5(pid=10528) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10528)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=10546): Process ended prematurely: osmo-stp_10.42.42.5(pid=10546) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10546)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10556): Process ended prematurely: osmo-stp_10.42.42.5(pid=10556) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10556)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10566): Process ended prematurely: osmo-stp_10.42.42.5(pid=10566) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10566)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10586): Process ended prematurely: osmo-stp_10.42.42.5(pid=10586) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10586)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=10598): Process ended prematurely: osmo-stp_10.42.42.5(pid=10598) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10598)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10616): Process ended prematurely: osmo-stp_10.42.42.5(pid=10616) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10616)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10626): Process ended prematurely: osmo-stp_10.42.42.5(pid=10626) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10626)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10636): Process ended prematurely: osmo-stp_10.42.42.5(pid=10636) [trial-2388↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10636)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=10653): Process ended prematurely: osmo-stp_10.42.42.5(pid=10653) [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10653)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10665): Process ended prematurely: osmo-stp_10.42.42.5(pid=10665) [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10665)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10684): Process ended prematurely: osmo-stp_10.42.42.5(pid=10684) [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10684)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10694): Process ended prematurely: osmo-stp_10.42.42.5(pid=10694) [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10694)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10704): Process ended prematurely: osmo-stp_10.42.42.5(pid=10704) [trial-2388↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10704)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10720): Process ended prematurely: osmo-stp_10.42.42.5(pid=10720) [trial-2388↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10720)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10734): Process ended prematurely: osmo-stp_10.42.42.5(pid=10734) [trial-2388↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10734)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=10743): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10743) [trial-2388↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10743)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10754): Process ended prematurely: osmo-stp_10.42.42.5(pid=10754) [trial-2388↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10754)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=10763): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10763) [trial-2388↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10763)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10775): Process ended prematurely: osmo-stp_10.42.42.5(pid=10775) [trial-2388↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10775)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10789): Process ended prematurely: osmo-stp_10.42.42.5(pid=10789) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10789)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10800): Process ended prematurely: osmo-stp_10.42.42.5(pid=10800) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10800)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10814): Process ended prematurely: osmo-stp_10.42.42.5(pid=10814) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10814)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10825): Process ended prematurely: osmo-stp_10.42.42.5(pid=10825) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10825)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10839): Process ended prematurely: osmo-stp_10.42.42.5(pid=10839) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10839)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10850): Process ended prematurely: osmo-stp_10.42.42.5(pid=10850) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10850)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10864): Process ended prematurely: osmo-stp_10.42.42.5(pid=10864) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10864)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10879): Process ended prematurely: osmo-stp_10.42.42.5(pid=10879) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10879)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10893): Process ended prematurely: osmo-stp_10.42.42.5(pid=10893) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10893)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10904): Process ended prematurely: osmo-stp_10.42.42.5(pid=10904) [trial-2388↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10904)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10930): Process ended prematurely: osmo-stp_10.42.42.5(pid=10930) [trial-2388↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10930)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10941): Process ended prematurely: osmo-stp_10.42.42.5(pid=10941) [trial-2388↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10941)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10955): Process ended prematurely: osmo-stp_10.42.42.5(pid=10955) [trial-2388↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10955)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10966): Process ended prematurely: osmo-stp_10.42.42.5(pid=10966) [trial-2388↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10966)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10980): Process ended prematurely: osmo-stp_10.42.42.5(pid=10980) [trial-2388↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10980)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10991): Process ended prematurely: osmo-stp_10.42.42.5(pid=10991) [trial-2388↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10991)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=11284): Process ended prematurely: osmo-stp_10.42.42.5(pid=11284) [trial-2388↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11284)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=11296): Process ended prematurely: osmo-stp_10.42.42.5(pid=11296) [trial-2388↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11296)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=11314): Process ended prematurely: osmo-stp_10.42.42.5(pid=11314) [trial-2388↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11314)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11324): Process ended prematurely: osmo-stp_10.42.42.5(pid=11324) [trial-2388↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11324)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11334): Process ended prematurely: osmo-stp_10.42.42.5(pid=11334) [trial-2388↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11334)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=11356): Process ended prematurely: osmo-stp_10.42.42.5(pid=11356) [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11356)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11368): Process ended prematurely: osmo-stp_10.42.42.5(pid=11368) [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11368)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=11386): Process ended prematurely: osmo-stp_10.42.42.5(pid=11386) [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11386)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11396): Process ended prematurely: osmo-stp_10.42.42.5(pid=11396) [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11396)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11406): Process ended prematurely: osmo-stp_10.42.42.5(pid=11406) [trial-2388↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11406)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=11425): Process ended prematurely: osmo-stp_10.42.42.5(pid=11425) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11425)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=11437): Process ended prematurely: osmo-stp_10.42.42.5(pid=11437) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11437)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=11455): Process ended prematurely: osmo-stp_10.42.42.5(pid=11455) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11455)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11465): Process ended prematurely: osmo-stp_10.42.42.5(pid=11465) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11465)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11475): Process ended prematurely: osmo-stp_10.42.42.5(pid=11475) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11475)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=11493): Process ended prematurely: osmo-stp_10.42.42.5(pid=11493) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11493)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=11505): Process ended prematurely: osmo-stp_10.42.42.5(pid=11505) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11505)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=11523): Process ended prematurely: osmo-stp_10.42.42.5(pid=11523) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11523)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11533): Process ended prematurely: osmo-stp_10.42.42.5(pid=11533) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11533)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11543): Process ended prematurely: osmo-stp_10.42.42.5(pid=11543) [trial-2388↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11543)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11556): Process ended prematurely: osmo-stp_10.42.42.5(pid=11556) [trial-2388↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11556)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11571): Process ended prematurely: osmo-stp_10.42.42.5(pid=11571) [trial-2388↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11571)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=11579): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11579) [trial-2388↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11579)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11589): Process ended prematurely: osmo-stp_10.42.42.5(pid=11589) [trial-2388↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11589)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=11598): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11598) [trial-2388↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11598)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11608): Process ended prematurely: osmo-stp_10.42.42.5(pid=11608) [trial-2388↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11608)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11622): Process ended prematurely: osmo-stp_10.42.42.5(pid=11622) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11622)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11633): Process ended prematurely: osmo-stp_10.42.42.5(pid=11633) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11633)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11649): Process ended prematurely: osmo-stp_10.42.42.5(pid=11649) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11649)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11660): Process ended prematurely: osmo-stp_10.42.42.5(pid=11660) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11660)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11674): Process ended prematurely: osmo-stp_10.42.42.5(pid=11674) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11674)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11685): Process ended prematurely: osmo-stp_10.42.42.5(pid=11685) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11685)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11699): Process ended prematurely: osmo-stp_10.42.42.5(pid=11699) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11699)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11713): Process ended prematurely: osmo-stp_10.42.42.5(pid=11713) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11713)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11727): Process ended prematurely: osmo-stp_10.42.42.5(pid=11727) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11727)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11738): Process ended prematurely: osmo-stp_10.42.42.5(pid=11738) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11738)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11753): Process ended prematurely: osmo-stp_10.42.42.5(pid=11753) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11753)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11764): Process ended prematurely: osmo-stp_10.42.42.5(pid=11764) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11764)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11779): Process ended prematurely: osmo-stp_10.42.42.5(pid=11779) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11779)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11790): Process ended prematurely: osmo-stp_10.42.42.5(pid=11790) [trial-2388↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11790)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11804): Process ended prematurely: osmo-stp_10.42.42.5(pid=11804) [trial-2388↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11804)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11815): Process ended prematurely: osmo-stp_10.42.42.5(pid=11815) [trial-2388↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11815)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=11833): Process ended prematurely: osmo-stp_10.42.42.5(pid=11833) [trial-2388↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11833)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11848): Process ended prematurely: osmo-stp_10.42.42.5(pid=11848) [trial-2388↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11848)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=11866): Process ended prematurely: osmo-stp_10.42.42.5(pid=11866) [trial-2388↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11866)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11876): Process ended prematurely: osmo-stp_10.42.42.5(pid=11876) [trial-2388↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11876)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11886): Process ended prematurely: osmo-stp_10.42.42.5(pid=11886) [trial-2388↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11886)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=11903): Process ended prematurely: osmo-stp_10.42.42.5(pid=11903) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11903)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11916): Process ended prematurely: osmo-stp_10.42.42.5(pid=11916) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11916)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=11934): Process ended prematurely: osmo-stp_10.42.42.5(pid=11934) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11934)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11944): Process ended prematurely: osmo-stp_10.42.42.5(pid=11944) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11944)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11954): Process ended prematurely: osmo-stp_10.42.42.5(pid=11954) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11954)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11971): Process ended prematurely: osmo-stp_10.42.42.5(pid=11971) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11971)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=11984): Process ended prematurely: osmo-stp_10.42.42.5(pid=11984) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11984)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=12002): Process ended prematurely: osmo-stp_10.42.42.5(pid=12002) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12002)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12013): Process ended prematurely: osmo-stp_10.42.42.5(pid=12013) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12013)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12023): Process ended prematurely: osmo-stp_10.42.42.5(pid=12023) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12023)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=12040): Process ended prematurely: osmo-stp_10.42.42.5(pid=12040) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12040)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=12055): Process ended prematurely: osmo-stp_10.42.42.5(pid=12055) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12055)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=12073): Process ended prematurely: osmo-stp_10.42.42.5(pid=12073) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12073)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12083): Process ended prematurely: osmo-stp_10.42.42.5(pid=12083) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12083)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12093): Process ended prematurely: osmo-stp_10.42.42.5(pid=12093) [trial-2388↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12093)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12106): Process ended prematurely: osmo-stp_10.42.42.5(pid=12106) [trial-2388↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12106)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12123): Process ended prematurely: osmo-stp_10.42.42.5(pid=12123) [trial-2388↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12123)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=12131): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12131) [trial-2388↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12131)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12141): Process ended prematurely: osmo-stp_10.42.42.5(pid=12141) [trial-2388↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12141)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=12150): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12150) [trial-2388↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12150)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12160): Process ended prematurely: osmo-stp_10.42.42.5(pid=12160) [trial-2388↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12160)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12175): Process ended prematurely: osmo-stp_10.42.42.5(pid=12175) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12175)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12186): Process ended prematurely: osmo-stp_10.42.42.5(pid=12186) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12186)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12200): Process ended prematurely: osmo-stp_10.42.42.5(pid=12200) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12200)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12211): Process ended prematurely: osmo-stp_10.42.42.5(pid=12211) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12211)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12225): Process ended prematurely: osmo-stp_10.42.42.5(pid=12225) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12225)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12236): Process ended prematurely: osmo-stp_10.42.42.5(pid=12236) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12236)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12250): Process ended prematurely: osmo-stp_10.42.42.5(pid=12250) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12250)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12261): Process ended prematurely: osmo-stp_10.42.42.5(pid=12261) [trial-2388↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12261)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12277): Process ended prematurely: osmo-stp_10.42.42.5(pid=12277) [trial-2388↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12277)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12288): Process ended prematurely: osmo-stp_10.42.42.5(pid=12288) [trial-2388↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12288)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12302): Process ended prematurely: osmo-stp_10.42.42.5(pid=12302) [trial-2388↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12302)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12313): Process ended prematurely: osmo-stp_10.42.42.5(pid=12313) [trial-2388↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12313)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=12603): Process ended prematurely: osmo-stp_10.42.42.5(pid=12603) [trial-2388↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12603)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=12615): Process ended prematurely: osmo-stp_10.42.42.5(pid=12615) [trial-2388↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12615)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=12633): Process ended prematurely: osmo-stp_10.42.42.5(pid=12633) [trial-2388↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12633)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12644): Process ended prematurely: osmo-stp_10.42.42.5(pid=12644) [trial-2388↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12644)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12654): Process ended prematurely: osmo-stp_10.42.42.5(pid=12654) [trial-2388↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12654)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=12675): Process ended prematurely: osmo-stp_10.42.42.5(pid=12675) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12675)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=12687): Process ended prematurely: osmo-stp_10.42.42.5(pid=12687) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12687)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=12705): Process ended prematurely: osmo-stp_10.42.42.5(pid=12705) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12705)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12715): Process ended prematurely: osmo-stp_10.42.42.5(pid=12715) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12715)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12725): Process ended prematurely: osmo-stp_10.42.42.5(pid=12725) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12725)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=12745): Process ended prematurely: osmo-stp_10.42.42.5(pid=12745) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12745)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=12757): Process ended prematurely: osmo-stp_10.42.42.5(pid=12757) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12757)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=12775): Process ended prematurely: osmo-stp_10.42.42.5(pid=12775) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12775)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12787): Process ended prematurely: osmo-stp_10.42.42.5(pid=12787) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12787)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12797): Process ended prematurely: osmo-stp_10.42.42.5(pid=12797) [trial-2388↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12797)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12810): Process ended prematurely: osmo-stp_10.42.42.5(pid=12810) [trial-2388↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12810)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12823): Process ended prematurely: osmo-stp_10.42.42.5(pid=12823) [trial-2388↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12823)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12832): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12832) [trial-2388↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12832)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12843): Process ended prematurely: osmo-stp_10.42.42.5(pid=12843) [trial-2388↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12843)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12857): Process ended prematurely: osmo-stp_10.42.42.5(pid=12857) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12857)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12868): Process ended prematurely: osmo-stp_10.42.42.5(pid=12868) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12868)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12883): Process ended prematurely: osmo-stp_10.42.42.5(pid=12883) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12883)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12895): Process ended prematurely: osmo-stp_10.42.42.5(pid=12895) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12895)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12909): Process ended prematurely: osmo-stp_10.42.42.5(pid=12909) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12909)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12920): Process ended prematurely: osmo-stp_10.42.42.5(pid=12920) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12920)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12934): Process ended prematurely: osmo-stp_10.42.42.5(pid=12934) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12934)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12945): Process ended prematurely: osmo-stp_10.42.42.5(pid=12945) [trial-2388↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12945)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12960): Process ended prematurely: osmo-stp_10.42.42.5(pid=12960) [trial-2388↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12960)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12971): Process ended prematurely: osmo-stp_10.42.42.5(pid=12971) [trial-2388↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12971)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12985): Process ended prematurely: osmo-stp_10.42.42.5(pid=12985) [trial-2388↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12985)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12996): Process ended prematurely: osmo-stp_10.42.42.5(pid=12996) [trial-2388↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12996)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13010): Process ended prematurely: osmo-stp_10.42.42.5(pid=13010) [trial-2388↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13010)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13022): Process ended prematurely: osmo-stp_10.42.42.5(pid=13022) [trial-2388↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13022)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=13044): Process ended prematurely: osmo-stp_10.42.42.5(pid=13044) [trial-2388↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13044)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=13056): Process ended prematurely: osmo-stp_10.42.42.5(pid=13056) [trial-2388↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13056)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=13074): Process ended prematurely: osmo-stp_10.42.42.5(pid=13074) [trial-2388↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13074)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13084): Process ended prematurely: osmo-stp_10.42.42.5(pid=13084) [trial-2388↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13084)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13095): Process ended prematurely: osmo-stp_10.42.42.5(pid=13095) [trial-2388↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13095)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13112): Process ended prematurely: osmo-stp_10.42.42.5(pid=13112) [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13112)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13124): Process ended prematurely: osmo-stp_10.42.42.5(pid=13124) [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13124)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=13142): Process ended prematurely: osmo-stp_10.42.42.5(pid=13142) [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13142)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13152): Process ended prematurely: osmo-stp_10.42.42.5(pid=13152) [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13152)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13162): Process ended prematurely: osmo-stp_10.42.42.5(pid=13162) [trial-2388↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13162)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=13182): Process ended prematurely: osmo-stp_10.42.42.5(pid=13182) [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13182)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=13194): Process ended prematurely: osmo-stp_10.42.42.5(pid=13194) [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13194)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=13212): Process ended prematurely: osmo-stp_10.42.42.5(pid=13212) [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13212)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13222): Process ended prematurely: osmo-stp_10.42.42.5(pid=13222) [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13222)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13232): Process ended prematurely: osmo-stp_10.42.42.5(pid=13232) [trial-2388↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13232)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13250): Process ended prematurely: osmo-stp_10.42.42.5(pid=13250) [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13250)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13262): Process ended prematurely: osmo-stp_10.42.42.5(pid=13262) [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13262)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=13280): Process ended prematurely: osmo-stp_10.42.42.5(pid=13280) [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13280)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13290): Process ended prematurely: osmo-stp_10.42.42.5(pid=13290) [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13290)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13300): Process ended prematurely: osmo-stp_10.42.42.5(pid=13300) [trial-2388↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13300)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13313): Process ended prematurely: osmo-stp_10.42.42.5(pid=13313) [trial-2388↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13313)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=13323): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13323) [trial-2388↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13323)] FAIL: esme_connect_policy_closed.py (2.2 sec) Error: osmo-nitb_10.42.42.2(pid=13325): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13325) [trial-2388↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13325)] FAIL: esme_ms_sms_storeforward.py (2.7 sec) Error: osmo-nitb_10.42.42.2(pid=13327): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13327) [trial-2388↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13327)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=13329): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13329) [trial-2388↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13329)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=13338): Process ended prematurely: osmo-hlr_10.42.42.2(pid=13338) [trial-2388↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13338)] FAIL: esme_connect_policy_closed.py (5.7 sec) Error: osmo-hlr_10.42.42.2(pid=13349): Process ended prematurely: osmo-hlr_10.42.42.2(pid=13349) [trial-2388↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13349)] FAIL: esme_ms_sms_storeforward.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=13361): Process ended prematurely: osmo-stp_10.42.42.5(pid=13361) [trial-2388↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13361)] FAIL: esme_ms_sms_transaction.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13372): Process ended prematurely: osmo-stp_10.42.42.5(pid=13372) [trial-2388↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13372)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13386): Process ended prematurely: osmo-stp_10.42.42.5(pid=13386) [trial-2388↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13386)] FAIL: register_a5_0_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13401): Process ended prematurely: osmo-stp_10.42.42.5(pid=13401) [trial-2388↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13401)] FAIL: register_a5_1_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13412): Process ended prematurely: osmo-stp_10.42.42.5(pid=13412) [trial-2388↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13412)] FAIL: register_a5_3_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13423): Process ended prematurely: osmo-stp_10.42.42.5(pid=13423) [trial-2388↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13423)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.7 sec) Error: srsepc(pid=13443): Process ended prematurely: srsepc(pid=13443) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13443)] FAIL: iperf3_bidir.py (18.8 sec) Error: srsepc(pid=13460): Process ended prematurely: srsepc(pid=13460) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13460)] FAIL: iperf3_dl.py (18.7 sec) Error: srsepc(pid=13476): Process ended prematurely: srsepc(pid=13476) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13476)] FAIL: iperf3_ul.py (18.8 sec) Error: srsepc(pid=13492): Process ended prematurely: srsepc(pid=13492) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13492)] FAIL: ping.py (18.3 sec) Error: srsepc(pid=13509): Process ended prematurely: srsepc(pid=13509) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13509)] FAIL: rrc_idle_mo_ping.py (18.2 sec) Error: srsepc(pid=13525): Process ended prematurely: srsepc(pid=13525) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13525)] FAIL: rrc_idle_mt_ping.py (18.4 sec) Error: srsepc(pid=13541): Process ended prematurely: srsepc(pid=13541) [trial-2388↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=13541)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13557): Process ended prematurely: osmo-stp_10.42.42.5(pid=13557) [trial-2388↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13557)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13571): Process ended prematurely: osmo-stp_10.42.42.5(pid=13571) [trial-2388↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13571)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13585): Process ended prematurely: osmo-stp_10.42.42.5(pid=13585) [trial-2388↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13585)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=13599): Process ended prematurely: osmo-stp_10.42.42.5(pid=13599) [trial-2388↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13599)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13613): Process ended prematurely: osmo-stp_10.42.42.5(pid=13613) [trial-2388↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13613)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13898): Process ended prematurely: osmo-stp_10.42.42.5(pid=13898) [trial-2388↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13898)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=13912): Process ended prematurely: osmo-stp_10.42.42.5(pid=13912) [trial-2388↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13912)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13927): Process ended prematurely: osmo-stp_10.42.42.5(pid=13927) [trial-2388↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13927)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13941): Process ended prematurely: osmo-stp_10.42.42.5(pid=13941) [trial-2388↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13941)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13955): Process ended prematurely: osmo-stp_10.42.42.5(pid=13955) [trial-2388↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13955)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13969): Process ended prematurely: osmo-stp_10.42.42.5(pid=13969) [trial-2388↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13969)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13986): Process ended prematurely: osmo-stp_10.42.42.5(pid=13986) [trial-2388↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13986)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14000): Process ended prematurely: osmo-stp_10.42.42.5(pid=14000) [trial-2388↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14000)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14014): Process ended prematurely: osmo-stp_10.42.42.5(pid=14014) [trial-2388↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14014)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14028): Process ended prematurely: osmo-stp_10.42.42.5(pid=14028) [trial-2388↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14028)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14046): Process ended prematurely: osmo-stp_10.42.42.5(pid=14046) [trial-2388↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14046)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14060): Process ended prematurely: osmo-stp_10.42.42.5(pid=14060) [trial-2388↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14060)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=14074): Process ended prematurely: osmo-stp_10.42.42.5(pid=14074) [trial-2388↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14074)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14088): Process ended prematurely: osmo-stp_10.42.42.5(pid=14088) [trial-2388↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14088)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14102): Process ended prematurely: osmo-stp_10.42.42.5(pid=14102) [trial-2388↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14102)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14116): Process ended prematurely: osmo-stp_10.42.42.5(pid=14116) [trial-2388↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14116)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=14130): Process ended prematurely: osmo-stp_10.42.42.5(pid=14130) [trial-2388↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14130)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14144): Process ended prematurely: osmo-stp_10.42.42.5(pid=14144) [trial-2388↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14144)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14158): Process ended prematurely: osmo-stp_10.42.42.5(pid=14158) [trial-2388↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14158)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14172): Process ended prematurely: osmo-stp_10.42.42.5(pid=14172) [trial-2388↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14172)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14186): Process ended prematurely: osmo-stp_10.42.42.5(pid=14186) [trial-2388↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14186)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=14200): Process ended prematurely: osmo-stp_10.42.42.5(pid=14200) [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14200)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14214): Process ended prematurely: osmo-stp_10.42.42.5(pid=14214) [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14214)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14228): Process ended prematurely: osmo-stp_10.42.42.5(pid=14228) [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14228)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14242): Process ended prematurely: osmo-stp_10.42.42.5(pid=14242) [trial-2388↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14242)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=14256): Process ended prematurely: osmo-stp_10.42.42.5(pid=14256) [trial-2388↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14256)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14270): Process ended prematurely: osmo-stp_10.42.42.5(pid=14270) [trial-2388↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14270)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14284): Process ended prematurely: osmo-stp_10.42.42.5(pid=14284) [trial-2388↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14299): Process ended prematurely: osmo-stp_10.42.42.5(pid=14299) [trial-2388↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14299)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14313): Process ended prematurely: osmo-stp_10.42.42.5(pid=14313) [trial-2388↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14313)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=14327): Process ended prematurely: osmo-stp_10.42.42.5(pid=14327) [trial-2388↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14327)] + rm -rf trial-2388/inst + cd trial-2388 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-13 10:04:48 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388-run.tgz run.2022-12-13_10-04-59 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2388-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17680.tgz osmo-bts-oc2g.build-5536.tgz osmo-bts-sysmo.build-8040.tgz osmo-bts.build-7509.tgz osmo-ggsn.build-6690.tgz osmo-hlr.build-8713.tgz osmo-hnbgw.build-2985.tgz osmo-mgw.build-8959.tgz osmo-msc.build-29304.tgz osmo-nitb.build-12989.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30088.tgz osmo-stp.build-9255.tgz osmo-trx.build-4680.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE